-- Logs begin at Mon 2022-10-17 09:43:58 UTC, end at Mon 2022-10-17 10:49:08 UTC. -- Oct 17 10:16:11.484924 dv-cinder-860209-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 10:16:11.492466 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 10:16:11 2022] *** Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: nodename: dv-cinder-860209-5-iscsi Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: machine: x86_64 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: clock source: unix Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: pcre jit disabled Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: detected number of CPU cores: 4 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: current working directory: / Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: detected binary path: /usr/bin/uwsgi-core Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: your processes number limit is 47680 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: your memory page size is 4096 bytes Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: detected max file descriptor number: 2048 Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: lock engine: pthread robust mutexes Oct 17 10:16:11.495246 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: thunder lock: enabled Oct 17 10:16:11.496270 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 10:16:11.496270 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 10:16:11.535140 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: Python main interpreter initialized at 0x558f93f059c0 Oct 17 10:16:11.535140 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: python threads support enabled Oct 17 10:16:11.535140 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: your server socket listen backlog is limited to 100 connections Oct 17 10:16:11.535140 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: your mercy for graceful operations on workers is 90 seconds Oct 17 10:16:11.535491 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 10:16:11.535571 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: *** Operational MODE: preforking *** Oct 17 10:16:11.535807 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: *** uWSGI is running in multiple interpreter mode *** Oct 17 10:16:11.535807 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: spawned uWSGI master process (pid: 103686) Oct 17 10:16:11.535997 dv-cinder-860209-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 10:16:11.537211 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: spawned uWSGI worker 1 (pid: 103687, cores: 1) Oct 17 10:16:11.537211 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: spawned uWSGI worker 2 (pid: 103688, cores: 1) Oct 17 10:16:11.537211 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 10:16:12.191654 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 10:16:12.204836 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 10:16:13.314820 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:16:13.314820 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: from cryptography.utils import int_from_bytes Oct 17 10:16:13.315527 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:16:13.315527 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: from cryptography.utils import int_from_bytes Oct 17 10:16:13.318980 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:16:13.318980 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: from cryptography.utils import int_from_bytes Oct 17 10:16:13.319447 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:16:13.319447 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: from cryptography.utils import int_from_bytes Oct 17 10:16:15.779086 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:16:15.779766 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:16:15.779860 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:16:15.780229 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:16:15.780318 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:16:15.780400 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:16:15.780400 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:16:15.781282 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:16:15.781387 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.781480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:16:15.781715 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:16:15.781822 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782091 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782186 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782432 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782525 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782753 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.782854 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783059 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783160 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783470 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783681 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.783777 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784000 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784096 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784253 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784349 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784564 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784658 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784870 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.784958 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-5-iscsi {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785185 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785482 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785575 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-5-iscsi {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785793 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.785887 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786104 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786195 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786431 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786531 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786745 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.786833 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.787042 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.787129 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.787358 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.787535 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.787646 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.788672 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.788818 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.788942 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789083 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789210 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789341 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789471 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789598 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789727 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789864 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.789997 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790136 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790250 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790397 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790533 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790746 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.790876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791000 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791120 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791249 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791381 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-5-iscsi {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791505 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791628 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791760 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-5-iscsi {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.791885 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792008 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792130 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792253 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792512 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792658 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.792916 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793096 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793225 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793405 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793533 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793725 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.793862 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794047 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794183 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794369 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794515 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794695 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.794832 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795008 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795134 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795303 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795436 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795610 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795747 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.795914 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796040 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796257 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796383 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796570 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796856 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.796980 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797166 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797287 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797411 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797592 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797714 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.797840 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798032 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798145 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798367 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798474 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798689 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798782 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.798932 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799101 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799240 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799374 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799501 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799625 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799777 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.799919 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800079 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800206 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800379 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800515 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800679 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800820 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.800978 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801106 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801276 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801403 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801574 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801710 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.801872 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802000 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802171 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802305 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802511 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802650 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802819 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.802947 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803132 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803261 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803432 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803561 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803737 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.803864 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804056 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804192 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804356 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804483 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804656 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804790 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.804976 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805110 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805284 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805412 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805590 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.805902 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806036 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806215 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806403 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806531 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806669 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.806861 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807001 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807133 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807265 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807402 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807535 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807722 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.807858 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808021 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808148 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808270 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808400 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808532 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808665 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808828 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.808962 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809140 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809267 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809438 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809580 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809737 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.809881 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810034 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810167 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810344 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810475 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810646 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.810772 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811027 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811171 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811307 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811432 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811568 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811693 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.811873 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812032 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812260 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812511 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812647 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812826 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.812955 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813133 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813271 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813428 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813554 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813732 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.813858 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814035 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814172 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814345 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814489 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814650 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814831 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.814965 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815159 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815285 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815443 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815583 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815707 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815831 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.815961 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816105 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816231 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816416 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816543 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816713 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.816865 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817063 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817192 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817316 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817439 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817587 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817727 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.817884 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818012 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818194 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818319 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818519 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818646 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818818 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.818947 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819120 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819246 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819414 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819541 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819712 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.819845 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820005 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820132 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820433 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820591 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820718 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.820886 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821013 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821176 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821302 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821468 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821594 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821758 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.821894 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822056 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822182 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822373 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822504 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822674 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822815 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.822973 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823101 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823268 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823402 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823578 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823715 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823877 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.823996 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.824194 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:16:15.824323 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.824527 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.824664 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.824832 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.824966 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825158 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825286 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825481 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825609 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825794 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.825921 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826097 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826225 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826434 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826564 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826746 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.826880 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.827047 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.827242 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.827877 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828005 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828141 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828265 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828446 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828591 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828754 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.828904 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829075 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829205 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829382 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829512 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829690 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829819 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.829998 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830126 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830295 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830485 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830613 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830744 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.830924 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831053 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831234 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831369 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831537 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831671 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831864 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.831991 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832178 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832314 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832493 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832619 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832811 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.832939 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833125 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833267 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833429 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833558 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833732 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.833860 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834035 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834164 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834366 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834500 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834677 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834805 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.834981 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835292 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835419 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835597 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835727 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.835910 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836038 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836219 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836339 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836520 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836652 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836868 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.836996 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837120 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837257 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837448 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837575 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837709 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.837843 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838010 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838138 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838340 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838485 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838658 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838787 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.838964 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839092 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839275 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839413 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839581 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839709 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.839884 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840013 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840189 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840325 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840486 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840620 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840786 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.840914 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841085 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841222 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841386 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841513 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841686 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841815 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.841995 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.842130 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.842297 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.842457 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.842630 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.842764 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.843004 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.843673 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.843832 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.843961 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844140 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844326 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844465 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844637 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844773 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.844950 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845086 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845260 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845392 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845571 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845700 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.845876 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846013 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846188 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846317 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846513 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846673 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846812 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.846938 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847114 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847246 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847493 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847632 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847771 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.847897 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848030 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848155 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848311 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848691 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848859 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.848988 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849167 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849297 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849472 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849607 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849782 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.849918 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850087 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850224 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850415 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850557 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850739 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.850876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851051 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851179 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851348 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851476 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851668 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851808 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.851985 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852113 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852295 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852422 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852595 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852733 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.852898 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853038 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853164 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853287 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853467 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853597 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853763 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.853892 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854065 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854193 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854381 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854513 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854680 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854810 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.854977 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855105 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855408 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855571 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855708 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855869 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.855998 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856174 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856313 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856471 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856597 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856768 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.856905 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857064 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857192 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857375 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857509 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857713 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857852 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.857979 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.858103 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.858298 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.858446 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.858738 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.858887 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.859247 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.859642 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.860316 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.860634 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.860763 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.860977 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861105 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861285 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861413 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861594 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861731 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.861910 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862052 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862216 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862403 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862556 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862697 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862864 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.862994 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863184 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863311 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863488 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863623 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863803 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.863938 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864104 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864231 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864413 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864549 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864722 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.864849 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865049 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865179 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865359 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865674 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865800 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.865977 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866105 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866290 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866440 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866619 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866746 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.866924 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867063 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867400 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867531 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867656 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867859 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.867997 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868132 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868258 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868388 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868517 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868692 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.868821 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869012 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869141 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869316 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869444 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869626 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869764 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.869924 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870052 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870232 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870411 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870577 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870727 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.870905 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871032 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871211 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871339 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871515 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871654 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871821 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.871954 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872125 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872251 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872429 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872566 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872735 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.872862 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873034 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873161 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873333 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873471 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873636 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873764 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.873944 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874070 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874294 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874453 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874626 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874754 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.874926 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875055 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875234 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875363 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875537 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875675 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875836 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.875971 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876133 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876262 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876442 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876568 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876748 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.876876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877051 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877178 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877356 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877483 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877658 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.877805 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878007 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878140 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878265 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878416 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878569 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878711 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.878876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879003 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879174 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879301 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879472 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879615 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879771 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.879905 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880099 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880225 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880402 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880537 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880701 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.880837 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881003 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881137 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881309 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881437 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881610 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881739 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.881918 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882043 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882222 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882380 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882550 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882687 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882870 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.882997 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883177 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883304 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883482 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883608 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883787 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.883915 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884094 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884228 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884399 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884525 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884702 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.884836 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885020 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885146 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885324 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885449 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885628 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885766 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.885933 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886233 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886383 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886565 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886704 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.886876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887002 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887184 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887437 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887566 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887764 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.887893 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888095 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888240 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888366 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888497 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888682 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.888811 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.889005 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.889245 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.889383 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.889579 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.889716 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.890451 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.890610 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.890770 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.890901 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891112 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891254 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891431 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891645 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891774 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.891898 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892081 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892212 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892396 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892526 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892693 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892831 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.892995 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893123 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893302 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893432 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893603 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893732 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.893903 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894031 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894201 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894387 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894516 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894639 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894819 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.894948 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895118 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895247 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895420 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895548 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895717 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.895852 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896018 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896145 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896323 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896451 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896620 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896760 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.896922 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897050 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897220 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897356 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897522 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897659 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.897844 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898027 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898170 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898399 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898531 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898666 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898792 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.898916 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899040 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899163 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899376 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899506 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899681 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.899994 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900121 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900294 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900431 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900590 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900727 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.900892 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901022 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901192 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901321 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901488 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901650 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901778 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.901902 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902079 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902212 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902395 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902523 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902695 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902837 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.902990 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903118 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903290 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903418 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903586 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903723 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.903896 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904025 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904197 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904324 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904494 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904634 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904793 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.904913 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.905094 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.905220 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.905393 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.905599 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.905881 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906009 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906201 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906350 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906533 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906664 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906838 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.906966 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907150 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907278 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907456 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907586 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907751 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.907878 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908056 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908197 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908345 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908536 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908670 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908794 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.908946 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909075 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909247 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909543 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909677 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909839 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.909981 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910144 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910463 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910592 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910762 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.910904 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911065 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911195 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911375 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911503 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911680 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911818 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.911975 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912102 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912276 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912402 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912571 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912706 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912869 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.912997 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913167 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913307 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913468 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913604 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913764 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.913892 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914060 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914189 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914507 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914673 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914813 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.914970 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915098 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915274 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915403 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915574 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915707 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915870 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.915998 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916167 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916304 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916462 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916590 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916762 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.916898 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917085 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917214 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917391 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917520 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917694 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917835 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.917999 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918126 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918300 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918467 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918669 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918808 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.918936 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919208 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919336 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919504 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919707 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919836 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.919960 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920084 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920207 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920390 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920527 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920687 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920823 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.920983 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.921766 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.921910 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922182 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922317 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922469 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922594 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922720 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.922858 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923014 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923153 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923318 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923447 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923621 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923768 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.923949 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924078 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924261 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924392 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924572 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924711 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.924974 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925302 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925418 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925552 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925687 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925813 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.925939 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926063 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926186 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926317 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926513 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926640 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926771 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.926896 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927020 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927143 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927265 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927390 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927513 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927637 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927804 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.927934 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928122 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928251 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928425 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928553 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928760 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.928910 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929044 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929182 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929314 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929439 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929592 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929729 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.929893 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930022 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930245 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930390 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930579 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930708 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.930886 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931010 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931194 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931331 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931497 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931624 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931801 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.931929 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932103 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932238 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932409 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932537 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932707 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.932835 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933115 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933245 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933416 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933544 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933717 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.933845 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934019 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934156 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934315 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934471 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934631 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934760 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.934933 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935063 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935252 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935383 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935549 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935683 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935848 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.935985 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.936145 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.936274 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.936460 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.936589 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.936833 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937051 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937189 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937315 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937479 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937607 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937786 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.937923 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938092 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938221 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938417 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938623 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938766 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.938973 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939101 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939225 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939349 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939524 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939740 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.939870 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940051 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940187 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940358 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940497 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940720 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.940847 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941024 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941154 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941342 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941659 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941788 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.941964 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942093 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942451 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942600 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942731 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.942915 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943043 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943224 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943353 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943529 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943669 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943848 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.943978 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944160 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944287 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944473 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944611 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944778 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.944907 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945100 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945231 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945422 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945560 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945738 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.945875 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946034 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946161 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946354 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946499 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946659 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946818 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.946956 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947082 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947251 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947405 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947534 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.947864 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948033 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948171 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948326 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948457 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948635 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948764 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.948951 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949156 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949288 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949413 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949537 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949669 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949844 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.949991 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950154 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950283 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950489 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950630 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950797 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.950944 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951095 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951222 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951395 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951529 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951700 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951841 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.951998 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.952128 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.952814 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.952983 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953121 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953249 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953447 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953575 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.953875 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954063 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954193 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954406 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954537 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954716 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.954845 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955021 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955151 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955324 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955445 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955626 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955767 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.955956 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956082 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956258 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956394 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956566 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956702 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.956884 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957012 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957182 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957310 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957478 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957616 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957780 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.957909 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958211 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958404 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958548 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958703 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.958832 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959004 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959149 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959387 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959521 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959647 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959771 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.959895 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960019 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960153 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960292 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960450 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960580 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960765 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.960895 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961068 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961198 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961363 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961499 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961662 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961803 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.961958 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962088 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962259 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962422 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962600 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962740 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.962900 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963028 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963210 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963337 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963521 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963662 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963825 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.963954 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964127 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964264 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964428 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964566 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964733 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.964861 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965042 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965170 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965351 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965481 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965658 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965794 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.965961 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966090 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966288 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966441 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966595 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966724 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.966907 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967036 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967219 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967422 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967552 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967744 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.967875 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968121 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968275 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968426 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968563 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968730 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.968861 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969037 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969166 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969387 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969526 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969651 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.969908 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970048 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970222 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970373 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970692 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.970873 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971011 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971187 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971316 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971500 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971629 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971809 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.971939 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972119 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972248 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972426 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972553 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972732 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.972860 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.973038 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.973166 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.973371 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.973754 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.973959 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974085 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974232 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974399 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974563 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974705 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.974874 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975003 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975181 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975311 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975486 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975624 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975789 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.975919 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976095 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976225 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976400 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976531 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976703 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.976832 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977006 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977135 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977315 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977445 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977620 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977742 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.977941 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978070 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978249 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978406 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978587 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978716 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.978891 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979027 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979198 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979326 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979539 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979674 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.979800 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980008 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980139 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980315 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980445 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980640 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980768 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.980957 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981088 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981274 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981403 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981583 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981720 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.981893 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982028 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982210 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982474 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982618 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982788 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.982918 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.983111 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.983238 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.983498 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984157 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984293 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984419 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984544 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984669 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984836 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.984965 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985133 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985264 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985445 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985581 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985749 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.985886 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986073 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986272 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986423 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986637 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986766 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.986950 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987081 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987269 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987398 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987589 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987723 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.987997 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988135 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988263 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988387 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988512 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988717 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.988857 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989190 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989376 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989506 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989692 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989824 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.989971 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990107 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990270 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990449 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990590 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990708 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.990890 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991019 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991188 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991316 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991491 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991620 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991787 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.991917 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992106 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992238 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992537 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992707 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.992834 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993003 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993139 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993308 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993436 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993643 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993779 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.993913 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994048 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994174 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994299 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994494 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994623 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994801 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.994946 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995082 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995214 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995388 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995516 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995685 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995823 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.995987 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996289 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996416 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996592 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996722 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.996894 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997022 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997204 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997333 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997503 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997631 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997802 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.997930 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998102 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998230 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998433 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998563 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998751 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.998931 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999063 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999220 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999466 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999595 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999757 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:15.999929 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000057 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000192 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000352 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000617 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000747 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.000951 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001080 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001270 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001402 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001579 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001707 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.001890 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002019 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002200 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002356 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002526 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002655 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.002825 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003086 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003432 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003558 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003735 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.003863 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004036 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004139 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004339 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004439 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004640 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004739 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.004942 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005042 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005244 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005343 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005549 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005649 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005851 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.005950 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006155 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006254 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006485 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006596 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006785 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.006873 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007089 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007191 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007388 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007487 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007693 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.007783 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008003 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008145 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008311 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008618 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008742 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.008923 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009050 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009231 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009359 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009533 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009667 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009835 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.009965 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010136 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010266 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010462 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010594 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010771 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.010901 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011093 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011236 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011401 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011529 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011700 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.011829 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012013 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012327 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012454 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012638 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012777 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.012954 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013084 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013267 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013396 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013572 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013702 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.013894 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.014002 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.014197 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.014296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.014532 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.015365 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.015473 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.015713 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.015891 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016151 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016240 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016482 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016572 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016796 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.016886 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017127 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017270 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017452 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017583 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017781 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.017905 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018030 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018147 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018359 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018492 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018680 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018810 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.018985 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019123 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019286 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019416 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019585 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019714 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.019887 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020029 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020185 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020315 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020481 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020610 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020778 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.020917 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021075 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021204 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021517 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021670 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021809 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.021966 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022095 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022260 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022404 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022593 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022724 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.022890 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023019 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023186 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023316 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023487 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023618 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023784 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.023913 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024124 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024254 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024389 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024523 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024649 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024774 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.024930 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025059 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025256 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025386 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025580 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025714 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.025887 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026023 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026189 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026316 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026520 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026652 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026827 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.026964 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027128 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027249 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027558 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027744 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.027880 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028056 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028185 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028358 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028485 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028681 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028810 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.028982 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029154 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029290 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029415 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029578 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029708 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.029881 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.030009 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.030183 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.030312 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031045 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031172 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031372 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031526 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031690 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.031862 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032002 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032179 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032317 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032495 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032632 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032832 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.032962 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033245 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033428 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033558 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033741 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.033873 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034071 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034283 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034455 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034583 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034719 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034845 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.034970 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035103 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035276 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035414 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035589 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035717 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.035894 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036024 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036199 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036341 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036510 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036639 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036817 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.036946 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037140 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037278 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037448 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037577 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037751 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.037880 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038062 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038190 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038400 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038532 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038716 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.038846 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039029 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039162 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039347 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039476 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039662 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039791 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.039971 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040099 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040278 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040416 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040577 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040706 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.040840 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103688) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:16:16.040979 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.041240 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.041587 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.041902 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.042250 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.042619 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.042941 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.043257 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.043565 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:16:16.043808 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:16:16.194007 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO dbcounter [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Registered counter for database nova_api Oct 17 10:16:16.197292 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Registered counter for database nova_api Oct 17 10:16:16.214476 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_db.sqlalchemy.engines [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.217330 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.221401 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writer thread running {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.224507 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.279144 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.context [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66ef73f3-9115-4ace-9509-220fc52b388b(cell1) {{(pid=103688) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 10:16:16.281225 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.context [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66ef73f3-9115-4ace-9509-220fc52b388b(cell1) {{(pid=103687) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 10:16:16.283108 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:16:16.283572 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:16:16.285018 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:16:16.285129 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:16:16.285491 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:16:16.285813 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:16:16.286243 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:16:16.287109 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:16:16.287833 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:16:16.288235 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:16:16.288327 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:16:16.290201 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO dbcounter [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Registered counter for database nova_cell0 Oct 17 10:16:16.290295 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:16:16.292211 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Registered counter for database nova_cell0 Oct 17 10:16:16.294186 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO dbcounter [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Registered counter for database nova_cell1 Oct 17 10:16:16.296400 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Registered counter for database nova_cell1 Oct 17 10:16:16.301722 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_db.sqlalchemy.engines [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.303534 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.306524 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_db.sqlalchemy.engines [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.309206 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.309844 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.315833 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writer thread running {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.317313 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writer thread running {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.451410 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.460239 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Registered counter for database nova_cell0 Oct 17 10:16:16.462776 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO dbcounter [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Registered counter for database nova_cell0 Oct 17 10:16:16.467410 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.470318 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_db.sqlalchemy.engines [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:16:16.472837 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.475225 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writer thread running {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:16:16.813939 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:16:16.814507 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: WARNING keystonemiddleware.auth_token [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:16:16.821344 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:16:16.821732 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: WARNING keystonemiddleware.auth_token [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:16:17.164791 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:16:17.166920 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: WARNING keystonemiddleware.auth_token [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:16:17.170765 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:16:17.173035 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: WARNING keystonemiddleware.auth_token [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:16:17.176814 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f93f059c0 pid: 103687 (default app) Oct 17 10:16:17.178305 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f93f059c0 pid: 103688 (default app) Oct 17 10:16:17.178888 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:16:17.180065 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-01567b13-977d-4de0-91c9-76fa1917c40f None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Oct 17 10:16:17.180467 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Oct 17 10:16:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:38.683673 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:38.685876 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Oct 17 10:17:38.686389 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:38.697826 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:38.698675 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell0:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:38.699532 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell1:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:38.701344 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:39.587624 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f8f1f3a7-55ef-46a4-9b77-44beb1f51acc admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:39.619671 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f8f1f3a7-55ef-46a4-9b77-44beb1f51acc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927027 Oct 17 10:17:39.620452 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 10:17:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:17:42.277709 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:42.278965 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-4e4ecc68-8fad-484d-bea5-20a7e6841375 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Oct 17 10:17:42.282441 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:42.724962 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-392ed33d-e2d8-463d-94a2-bae2268a1393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:42.771564 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-392ed33d-e2d8-463d-94a2-bae2268a1393 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485734 Oct 17 10:17:42.772157 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:17:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:17:42.786383 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_api:SELECT=3 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.787163 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_cell0:SELECT=3 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.789159 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_cell1:SELECT=3 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.789881 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:17:42.995622 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-34a0989c-2c3e-4caf-9592-3f83bebb1c1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:43.065436 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-34a0989c-2c3e-4caf-9592-3f83bebb1c1d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284074 Oct 17 10:17:43.066026 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 10:17:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:17:45.698681 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-392ed33d-e2d8-463d-94a2-bae2268a1393 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:45.699629 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-392ed33d-e2d8-463d-94a2-bae2268a1393 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 17 10:17:45.700144 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:46.377501 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-af383c31-d1b0-475e-b38d-63fe09c46085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "name": "ds512M", "id": "d1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:46.420244 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-af383c31-d1b0-475e-b38d-63fe09c46085 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.713543 Oct 17 10:17:46.421138 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:17:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:17:46.436429 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-369b796c-3b94-452c-a2ae-bcc1cdb2b041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:46.480107 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-369b796c-3b94-452c-a2ae-bcc1cdb2b041 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050189 Oct 17 10:17:46.486567 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 10:17:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:17:49.083582 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-af383c31-d1b0-475e-b38d-63fe09c46085 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:49.084656 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-af383c31-d1b0-475e-b38d-63fe09c46085 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 17 10:17:49.085060 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:49.507801 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-8c15d1b9-03dd-4da5-9c97-de4a30f25409 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "swap": 0, "ram": 1024}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:49.526830 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-8c15d1b9-03dd-4da5-9c97-de4a30f25409 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434596 Oct 17 10:17:49.527380 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:17:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:17:49.539716 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-fb845435-6eeb-479c-9c93-8c1d8b5566eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:49.569924 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-fb845435-6eeb-479c-9c93-8c1d8b5566eb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033799 Oct 17 10:17:49.570541 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 10:17:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:17:52.201549 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-8c15d1b9-03dd-4da5-9c97-de4a30f25409 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:52.203214 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-8c15d1b9-03dd-4da5-9c97-de4a30f25409 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Oct 17 10:17:52.203764 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:52.638981 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-1328df1c-8f95-4967-ac50-cf82e64c8e09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:52.658146 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-1328df1c-8f95-4967-ac50-cf82e64c8e09 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447922 Oct 17 10:17:52.671450 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-8ccc6a17-de63-4434-873d-fd26ad6ccf1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:52.675865 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:17:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 10:17:52.699234 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-8ccc6a17-de63-4434-873d-fd26ad6ccf1e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032102 Oct 17 10:17:52.706383 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 10:17:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:17:55.395305 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-1328df1c-8f95-4967-ac50-cf82e64c8e09 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:55.396556 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-1328df1c-8f95-4967-ac50-cf82e64c8e09 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 17 10:17:55.396750 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:55.832074 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:55.851210 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448235 Oct 17 10:17:55.851926 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:17:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 10:17:55.868229 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-c8d2de3d-01e8-4220-b268-4bb3ac016cd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:17:55.893494 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-c8d2de3d-01e8-4220-b268-4bb3ac016cd1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028832 Oct 17 10:17:55.894210 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 17 10:17:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:17:58.608588 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:58.609551 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 17 10:17:58.609945 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:17:59.025841 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-d99edbc2-212f-43b7-9bb7-eee5a65eb18c admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:17:59.057956 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-d99edbc2-212f-43b7-9bb7-eee5a65eb18c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440358 Oct 17 10:17:59.058753 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 10:17:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:18:01.794795 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:01.795852 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-504baaf3-b520-4e1c-b35f-bfc1dedb0ee7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Oct 17 10:18:01.796252 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:02.191649 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-a39b1bb8-cbf6-4f13-955e-de0873d6e620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:02.213414 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-a39b1bb8-cbf6-4f13-955e-de0873d6e620 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411032 Oct 17 10:18:02.214104 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:18:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:02.226748 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-90fd1a56-98bf-44e3-b2bb-b9302321c3b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:02.256122 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-90fd1a56-98bf-44e3-b2bb-b9302321c3b4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033235 Oct 17 10:18:02.256729 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 10:18:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:18:04.874983 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-a39b1bb8-cbf6-4f13-955e-de0873d6e620 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:04.876182 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-a39b1bb8-cbf6-4f13-955e-de0873d6e620 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Oct 17 10:18:04.876477 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:05.235816 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a5d3697a-3a42-4754-82e2-210fd092aee8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:05.255520 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a5d3697a-3a42-4754-82e2-210fd092aee8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.372767 Oct 17 10:18:05.256081 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:18:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:05.269081 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-d6dc1524-0c61-4699-8e38-5584ae049824 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:05.299354 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-d6dc1524-0c61-4699-8e38-5584ae049824 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034138 Oct 17 10:18:05.300035 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 10:18:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:18:07.997243 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a5d3697a-3a42-4754-82e2-210fd092aee8 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:07.998931 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a5d3697a-3a42-4754-82e2-210fd092aee8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002909 Oct 17 10:18:08.002630 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:08.455422 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-671c9fa7-88d5-4143-9d69-9157cea9e138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:08.478128 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-671c9fa7-88d5-4143-9d69-9157cea9e138 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.472473 Oct 17 10:18:08.478793 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:18:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:08.491981 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-536f2589-17a8-4f1b-b179-e0b660efa00b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:08.520081 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-536f2589-17a8-4f1b-b179-e0b660efa00b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031971 Oct 17 10:18:08.520872 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 10:18:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:18:11.177490 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-671c9fa7-88d5-4143-9d69-9157cea9e138 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:11.178612 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-671c9fa7-88d5-4143-9d69-9157cea9e138 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 17 10:18:11.179102 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:11.643677 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b69abe73-ff23-4c81-beac-57e8243ac1b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:11.651511 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:11.722508 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-b69abe73-ff23-4c81-beac-57e8243ac1b3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516334 Oct 17 10:18:11.722508 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:18:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:11.739606 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-3612e80c-7fbe-4519-90d2-844712ed9973 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:11.764334 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-3612e80c-7fbe-4519-90d2-844712ed9973 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032321 Oct 17 10:18:11.766743 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 10:18:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:18:14.542802 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b69abe73-ff23-4c81-beac-57e8243ac1b3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:14.544433 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-b69abe73-ff23-4c81-beac-57e8243ac1b3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Oct 17 10:18:14.545108 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:14.987812 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:15.000317 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:15.015787 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464455 Oct 17 10:18:15.023461 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 17 10:18:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:15.028989 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-5bf4846e-6440-467b-8d5c-5528cea7b9ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:15.058864 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-5bf4846e-6440-467b-8d5c-5528cea7b9ce admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034050 Oct 17 10:18:15.059881 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 17 10:18:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:18:31.457925 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:31.458888 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 17 10:18:31.459294 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:31.469922 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:18:31.847039 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-5d93a1dd-c93f-4d4c-9705-1c69e153e024 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:31.866659 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-5d93a1dd-c93f-4d4c-9705-1c69e153e024 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401182 Oct 17 10:18:31.867199 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 10:18:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:33.160616 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:33.161640 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-c869d03b-4728-4d40-ad32-5fa5d517d5ad admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 17 10:18:33.162034 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:33.677387 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b62ed5ab-d083-4cfe-9b8e-624e8578d1ba admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:33.682763 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-b62ed5ab-d083-4cfe-9b8e-624e8578d1ba admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b62ed5ab-d083-4cfe-9b8e-624e8578d1ba admin admin] Request method failure captured: Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept: application/json Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Connection: keep-alive Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Content-Length: 0 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Host: 10.222.0.16 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABjTSv5FF1rzchhCImNoR502-VBgHNXN4dOwcUrX2w_UgEkmRlE_M-3G0_GEf6hMdAMOkGEvPkimyvJb59OWt-NlbTEn0PQMAq_QnBXPZNKqApl0gzE6bhRjKzksaPaFCIqNgSqYDZBRvz0b-xeu7wiXGAS0VTLfMgt58rXqOD2NP90YBg Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Role: reader,member,admin Oct 17 10:18:33.686728 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Roles: reader,member,admin Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant: admin Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User: admin Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Name: admin Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: method: > Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: exception: Flavor 42 could not be found. Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: action_args: {'id': '42'} Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:33.688407 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:33.689595 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.691060 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b62ed5ab-d083-4cfe-9b8e-624e8578d1ba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:33.692548 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-b62ed5ab-d083-4cfe-9b8e-624e8578d1ba admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389988 Oct 17 10:18:33.692548 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 10:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:33.697927 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-7724b78f-fc0c-4180-b1db-d40a7cac699a admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:33.721374 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-7724b78f-fc0c-4180-b1db-d40a7cac699a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027033 Oct 17 10:18:33.721937 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:33.733284 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-279ad16a-3c18-4170-bbe5-0bf9e588401a admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:33.755208 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-279ad16a-3c18-4170-bbe5-0bf9e588401a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026957 Oct 17 10:18:33.755735 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:33.765668 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-04597f50-fb82-4912-9988-7b8ee801bbc5 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:33.771409 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.wsgi [None req-04597f50-fb82-4912-9988-7b8ee801bbc5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-04597f50-fb82-4912-9988-7b8ee801bbc5 admin admin] Request method failure captured: Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept: application/json Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept-Encoding: gzip, deflate Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Connection: keep-alive Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Content-Length: 0 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Host: 10.222.0.16 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-System-Scope: None Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: User-Agent: python-novaclient Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Auth-Token: gAAAAABjTSv5FF1rzchhCImNoR502-VBgHNXN4dOwcUrX2w_UgEkmRlE_M-3G0_GEf6hMdAMOkGEvPkimyvJb59OWt-NlbTEn0PQMAq_QnBXPZNKqApl0gzE6bhRjKzksaPaFCIqNgSqYDZBRvz0b-xeu7wiXGAS0VTLfMgt58rXqOD2NP90YBg Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Id: None Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Name: None Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Identity-Status: Confirmed Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Is-Admin-Project: True Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Id: default Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Name: Default Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Name: admin Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Role: reader,member,admin Oct 17 10:18:33.774810 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Roles: reader,member,admin Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant: admin Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Name: admin Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User: admin Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Id: default Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Name: Default Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Name: admin Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: method: > Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: exception: Flavor 42 could not be found. Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: action_args: {'id': '42'} Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:33.776408 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:33.777375 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:33.778561 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-04597f50-fb82-4912-9988-7b8ee801bbc5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:33.779588 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-04597f50-fb82-4912-9988-7b8ee801bbc5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014687 Oct 17 10:18:33.779588 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 10:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 10:18:34.989312 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-279ad16a-3c18-4170-bbe5-0bf9e588401a admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:34.990355 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-279ad16a-3c18-4170-bbe5-0bf9e588401a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 17 10:18:34.990764 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:35.516169 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-d8829da6-faee-4d5d-9056-098a4ca0f62d admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:35.521208 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.wsgi [None req-d8829da6-faee-4d5d-9056-098a4ca0f62d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-d8829da6-faee-4d5d-9056-098a4ca0f62d admin admin] Request method failure captured: Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept: application/json Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept-Encoding: gzip, deflate Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Connection: keep-alive Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Content-Length: 0 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Host: 10.222.0.16 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-System-Scope: None Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: User-Agent: python-novaclient Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Auth-Token: gAAAAABjTSv61jhaqtLauQBK2mxPCY7bAiHvuB1n0eZ-O-baR_rVxEUYdq8YJOs-2_IHelS-xMRzjXUI55zUu0XdTIM0lzLfd5JC0GGYslEGWq7X_Gz7o8yuzJmhxhXOqYNQ3DEBK6FSepFcEdQHF1ytKfixkkrijd2ZfnnuMLDZJRJz8QJvhlc Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Id: None Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Name: None Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Identity-Status: Confirmed Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Is-Admin-Project: True Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Id: default Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Name: Default Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Name: admin Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Role: reader,member,admin Oct 17 10:18:35.522747 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Roles: reader,member,admin Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant: admin Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Name: admin Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User: admin Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Id: default Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Name: Default Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Name: admin Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: method: > Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: exception: Flavor 84 could not be found. Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: action_args: {'id': '84'} Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:35.524296 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:35.525239 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.526496 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-d8829da6-faee-4d5d-9056-098a4ca0f62d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:35.528704 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-d8829da6-faee-4d5d-9056-098a4ca0f62d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396822 Oct 17 10:18:35.528704 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 10:18:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:35.535126 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-505e49f6-30f6-4ddc-af8b-d998d646b980 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:35.549923 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-505e49f6-30f6-4ddc-af8b-d998d646b980 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018386 Oct 17 10:18:35.550508 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:35.559768 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-36759156-5ec7-41b4-9867-5ea7cda88963 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:35.575570 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-36759156-5ec7-41b4-9867-5ea7cda88963 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019374 Oct 17 10:18:35.576091 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:35.585071 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-1c334184-925b-4a38-b8f7-bc1207828172 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:35.590635 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-1c334184-925b-4a38-b8f7-bc1207828172 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-1c334184-925b-4a38-b8f7-bc1207828172 admin admin] Request method failure captured: Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept: application/json Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Connection: keep-alive Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Content-Length: 0 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Host: 10.222.0.16 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABjTSv61jhaqtLauQBK2mxPCY7bAiHvuB1n0eZ-O-baR_rVxEUYdq8YJOs-2_IHelS-xMRzjXUI55zUu0XdTIM0lzLfd5JC0GGYslEGWq7X_Gz7o8yuzJmhxhXOqYNQ3DEBK6FSepFcEdQHF1ytKfixkkrijd2ZfnnuMLDZJRJz8QJvhlc Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Role: reader,member,admin Oct 17 10:18:35.592116 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Roles: reader,member,admin Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant: admin Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User: admin Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Name: admin Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: method: > Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: exception: Flavor 84 could not be found. Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: action_args: {'id': '84'} Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:35.593480 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:35.594430 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:35.595784 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-1c334184-925b-4a38-b8f7-bc1207828172 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:35.597008 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-1c334184-925b-4a38-b8f7-bc1207828172 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011837 Oct 17 10:18:35.597008 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 17 10:18:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 10:18:36.812814 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-36759156-5ec7-41b4-9867-5ea7cda88963 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:36.813818 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-36759156-5ec7-41b4-9867-5ea7cda88963 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 17 10:18:36.814243 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:37.327687 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4b94fb82-fcfb-410b-b87a-58c18061adf5 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:37.333490 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-4b94fb82-fcfb-410b-b87a-58c18061adf5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4b94fb82-fcfb-410b-b87a-58c18061adf5 admin admin] Request method failure captured: Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept: application/json Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Connection: keep-alive Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Content-Length: 0 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Host: 10.222.0.16 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABjTSv8SEtwk5igkLQSiQSj81V_an-RHPEfbeF6xZ0XtKeQUZF9KhugMKB3Ul3Wl_8RC8Oqoj5jJSOjkdNttGtCsFCON5cs8ghvH8mVbygBanKXlZzioUQISw5mH7FRDs60CmSWdc8wy4sg9uNaTacB11L3COPmXqjy4jVDVvhTBitLWO4 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Role: reader,member,admin Oct 17 10:18:37.335017 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Roles: reader,member,admin Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant: admin Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User: admin Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: X-User-Name: admin Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: method: > Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: exception: Flavor 451 could not be found. Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: action_args: {'id': '451'} Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:37.336584 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:37.337585 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.338955 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4b94fb82-fcfb-410b-b87a-58c18061adf5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:37.340288 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-4b94fb82-fcfb-410b-b87a-58c18061adf5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385669 Oct 17 10:18:37.340288 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:18:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 10:18:37.346374 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-165502eb-d658-4947-aec9-1f05bd799402 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:37.361448 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-165502eb-d658-4947-aec9-1f05bd799402 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018687 Oct 17 10:18:37.361971 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:37.371839 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:37.387086 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018635 Oct 17 10:18:37.387547 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 17 10:18:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:18:37.396491 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-3f921945-cc6a-4b98-8d44-5e071ef86dd2 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:37.401385 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.wsgi [None req-3f921945-cc6a-4b98-8d44-5e071ef86dd2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-3f921945-cc6a-4b98-8d44-5e071ef86dd2 admin admin] Request method failure captured: Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept: application/json Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Accept-Encoding: gzip, deflate Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Connection: keep-alive Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Content-Length: 0 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Host: 10.222.0.16 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-Api-Version: compute 2.92 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Openstack-System-Scope: None Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: User-Agent: python-novaclient Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Auth-Token: gAAAAABjTSv8SEtwk5igkLQSiQSj81V_an-RHPEfbeF6xZ0XtKeQUZF9KhugMKB3Ul3Wl_8RC8Oqoj5jJSOjkdNttGtCsFCON5cs8ghvH8mVbygBanKXlZzioUQISw5mH7FRDs60CmSWdc8wy4sg9uNaTacB11L3COPmXqjy4jVDVvhTBitLWO4 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Id: None Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Domain-Name: None Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Identity-Status: Confirmed Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Is-Admin-Project: True Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Id: default Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Domain-Name: Default Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Project-Name: admin Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Role: reader,member,admin Oct 17 10:18:37.403083 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Roles: reader,member,admin Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6150f4298a94f959838ad2351eaefb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant: admin Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Id: e6150f4298a94f959838ad2351eaefb9 Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-Tenant-Name: admin Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User: admin Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Id: default Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Domain-Name: Default Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Id: e9716bb37d07416391c7fe0f922727e4 Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: X-User-Name: admin Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: method: > Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: exception: Flavor 451 could not be found. Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: action_args: {'id': '451'} Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:18:37.404452 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:37.405298 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: ERROR nova.api.openstack.wsgi Oct 17 10:18:37.406633 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-3f921945-cc6a-4b98-8d44-5e071ef86dd2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103688) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:18:37.407872 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-3f921945-cc6a-4b98-8d44-5e071ef86dd2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011419 Oct 17 10:18:37.407872 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:18:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 10:18:38.622569 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:38.623586 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 17 10:18:38.623981 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:39.150939 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-c2a7666b-1328-4616-a345-d2a6579e325f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:39.170585 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-c2a7666b-1328-4616-a345-d2a6579e325f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405980 Oct 17 10:18:39.171126 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 10:18:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:40.395400 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:40.396597 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Oct 17 10:18:40.396994 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:40.918359 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-06719427-b223-452d-8901-9504c41b7878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:40.936722 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-06719427-b223-452d-8901-9504c41b7878 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402441 Oct 17 10:18:40.937268 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 10:18:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:42.151290 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:42.152926 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Oct 17 10:18:42.153317 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:42.672913 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-7ba08b49-3cd5-4a9a-9e6b-88dbaa728692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:42.692279 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-7ba08b49-3cd5-4a9a-9e6b-88dbaa728692 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402367 Oct 17 10:18:42.692819 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 10:18:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:43.918700 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:43.919709 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 17 10:18:43.920101 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:44.441840 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-6785c061-ed94-4a26-be41-4e3cda7cd970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:18:44.460201 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-6785c061-ed94-4a26-be41-4e3cda7cd970 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404305 Oct 17 10:18:44.460732 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 17 10:18:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:18:45.682455 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:45.684146 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Oct 17 10:18:45.684540 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:18:46.207993 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-f4b61e86-cb6c-4f6e-b0fe-f8ea46e6016b admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:18:46.228617 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-f4b61e86-cb6c-4f6e-b0fe-f8ea46e6016b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403585 Oct 17 10:18:46.229148 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 17 10:18:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:19:42.824555 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:42.825617 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f25dd71a-2900-4912-a9c3-3e2cd85e2ce3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 17 10:19:42.826011 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 17 10:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:19:42.836527 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:43.218669 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-e4be233d-530a-49fc-a708-8a9c62f07d3a admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:43.238795 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-e4be233d-530a-49fc-a708-8a9c62f07d3a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406662 Oct 17 10:19:43.239327 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 17 10:19:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:19:43.261177 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=14 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:19:43.264922 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a9d81e67-5fd5-482d-b93d-19ba9e74655b admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:43.271953 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a9d81e67-5fd5-482d-b93d-19ba9e74655b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012887 Oct 17 10:19:43.272466 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 17 10:19:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:19:43.284299 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-86f1fd48-f494-4430-a6fd-52c899d686e4 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:43.291699 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-86f1fd48-f494-4430-a6fd-52c899d686e4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010922 Oct 17 10:19:43.292220 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 17 10:19:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:19:43.303280 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:43.310786 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011109 Oct 17 10:19:43.311302 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 17 10:19:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:19:43.322116 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-66746e7f-e28a-4a0a-aa24-682286b1b395 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:19:43.330220 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-66746e7f-e28a-4a0a-aa24-682286b1b395 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011410 Oct 17 10:19:43.330709 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 17 10:19:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:22:38.983125 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:38.984239 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Oct 17 10:22:38.984704 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:22:39.127109 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_api:SELECT=6 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:39.284359 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:39.289234 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:39.290314 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:39.290775 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:39.291490 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:39.291934 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:39.292347 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:39.324756 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-dcfa44cf-2c57-4f59-9fa4-03918c4deec3 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198817 Oct 17 10:22:39.325349 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:22:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:22:40.416108 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:40.417109 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 17 10:22:40.417504 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:22:40.612476 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:40.615887 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:40.616350 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:40.616768 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:40.617469 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:40.617981 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:40.618568 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:40.637885 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-e10fb7a2-c72a-41cc-a45c-450ac4943e26 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080520 Oct 17 10:22:40.638388 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:22:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 10:22:52.104634 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:52.105673 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 17 10:22:52.106065 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:22:52.253866 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_cell0:SELECT=4 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:52.254590 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_cell1:SELECT=4 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:52.255186 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG dbcounter [-] [103688] Writing DB stats nova_api:SELECT=8 {{(pid=103688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:22:52.301961 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:52.305381 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:52.305841 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:52.306263 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:52.306987 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:52.307425 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:52.307832 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:52.333120 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-30f87281-7c96-47c7-adad-7c2dba1d6849 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083565 Oct 17 10:22:52.333600 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:22:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:22:53.404035 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:53.405039 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-75b9b059-0f68-4c90-bcf3-b3d058638d7d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 17 10:22:53.405437 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 17 10:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:22:53.596696 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG nova.api.openstack.wsgi [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Calling method '>' {{(pid=103688) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:22:53.600105 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:53.600580 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:53.601005 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:53.601962 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:22:53.602434 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:22:53.602850 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: DEBUG oslo_concurrency.lockutils [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103688) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:22:53.624195 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: INFO nova.api.openstack.requestlog [None req-384bac48-bbd4-4e7e-a46b-7179767ce889 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080235 Oct 17 10:22:53.624673 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: [pid: 103688|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 17 10:22:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:23:50.888485 dv-cinder-860209-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 10:23:50.889054 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: Mon Oct 17 10:23:50 2022 - graceful shutdown triggered... Oct 17 10:23:50.889554 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: Gracefully killing worker 1 (pid: 103687)... Oct 17 10:23:50.889937 dv-cinder-860209-5-iscsi devstack@n-api.service[103688]: Gracefully killing worker 2 (pid: 103688)... Oct 17 10:23:51.017442 dv-cinder-860209-5-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=4 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:23:51.890208 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: worker 1 buried after 1 seconds Oct 17 10:23:51.890799 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: worker 2 buried after 1 seconds Oct 17 10:23:51.890799 dv-cinder-860209-5-iscsi devstack@n-api.service[103686]: goodbye to uWSGI. Oct 17 10:23:51.891828 dv-cinder-860209-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 17 10:23:51.892406 dv-cinder-860209-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 10:23:51.895275 dv-cinder-860209-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 10:23:51.905257 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 10:23:51.907900 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 10:23:51 2022] *** Oct 17 10:23:51.908062 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 10:23:51.908194 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 10:23:51.908307 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: nodename: dv-cinder-860209-5-iscsi Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: machine: x86_64 Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: clock source: unix Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: pcre jit disabled Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: detected number of CPU cores: 4 Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: current working directory: / Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: detected binary path: /usr/bin/uwsgi-core Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: your processes number limit is 47680 Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: your memory page size is 4096 bytes Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: detected max file descriptor number: 2048 Oct 17 10:23:51.908440 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: lock engine: pthread robust mutexes Oct 17 10:23:51.909194 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: thunder lock: enabled Oct 17 10:23:51.909194 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 10:23:51.909194 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 10:23:51.948693 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: Python main interpreter initialized at 0x557de82e19c0 Oct 17 10:23:51.948693 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: python threads support enabled Oct 17 10:23:51.948693 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: your server socket listen backlog is limited to 100 connections Oct 17 10:23:51.948693 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: your mercy for graceful operations on workers is 90 seconds Oct 17 10:23:51.949142 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 10:23:51.949142 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: *** Operational MODE: preforking *** Oct 17 10:23:51.949408 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: *** uWSGI is running in multiple interpreter mode *** Oct 17 10:23:51.949408 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: spawned uWSGI master process (pid: 118662) Oct 17 10:23:51.949623 dv-cinder-860209-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 10:23:51.950532 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: spawned uWSGI worker 1 (pid: 118679, cores: 1) Oct 17 10:23:51.950647 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: spawned uWSGI worker 2 (pid: 118680, cores: 1) Oct 17 10:23:51.950728 dv-cinder-860209-5-iscsi devstack@n-api.service[118662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 10:23:52.610856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 10:23:52.619831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 10:23:53.772963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:23:53.772963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: from cryptography.utils import int_from_bytes Oct 17 10:23:53.773610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:23:53.773610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: from cryptography.utils import int_from_bytes Oct 17 10:23:53.782809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:23:53.782809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: from cryptography.utils import int_from_bytes Oct 17 10:23:53.783364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 10:23:53.783364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: from cryptography.utils import int_from_bytes Oct 17 10:23:56.178774 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:23:56.179385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:23:56.179620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:23:56.179931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:23:56.180235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:23:56.180588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.180916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.181293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.181961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.182059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.182456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.182788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.183113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.183446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.183710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.184031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.184505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-5-iscsi {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.184834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.185148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.185463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.185785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.185977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 10:23:56.186496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.186600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 10:23:56.186686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.186768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.186848 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 10:23:56.187176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 10:23:56.187363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.187544 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 10:23:56.187717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.187908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188209 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.188872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189465 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189769 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.189918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.190089 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.190230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.190384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.190489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.190583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-5-iscsi {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-5-iscsi {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.191992 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.192996 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.193134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.193234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.193487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.193632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194429 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.194956 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195299 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195397 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195721 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.195935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.196027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.196264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.196415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.196578 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197690 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197906 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.197999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.198557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-5-iscsi {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.198711 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.199920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200106 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200706 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200826 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.200961 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.201966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.202996 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.203933 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.204836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205161 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205740 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.205901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206500 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.206976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.207909 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.208990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209089 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.209929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.210982 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211666 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.211902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.212111 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.212210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.212942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.213892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.214865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.215883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216089 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216399 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.216812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217325 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.217938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218587 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.218897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.219942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.220876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.221056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.221183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.221980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222478 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.222939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.223047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.223169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.223285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.223401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.223524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.224645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.224786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.224929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.224929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225289 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225379 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.225898 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.225988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.226073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.226168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.226259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.226360 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.226460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.226552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.226640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.227181 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.227288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.227431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.227521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.227743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.227837 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.228642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.229241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.229352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.229446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.229539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.229634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.229730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.229824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.229915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.230033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.230134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.230377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.230703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.231038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.231357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.231486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.231679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.231876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.232023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.232145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.232348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.232442 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.232636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.232782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.232970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.233100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.233292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.233388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 10:23:56.233607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.233748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.233954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234048 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.234979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.235934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236339 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.236995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.237936 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.238917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.239863 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240089 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.240822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.241990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.242947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.243922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244256 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.244999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.245930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.246882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.247859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248456 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248761 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.248974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.249913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.250987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.251180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.251315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.252193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.252765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.252765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.252994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253572 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.253920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.254739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.254739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.254946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255091 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.255890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.256984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257305 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257491 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.257876 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258141 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258688 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.258985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259569 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.259972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260329 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260871 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.260967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.261925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262606 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.262905 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.263968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.264856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265835 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.265977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.266943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.267427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.267623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.267774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.268728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.268898 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269341 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.269937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.270216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.270438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.270592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.270737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.270890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271189 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.271936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.272636 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.272815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.272969 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273256 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273567 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273723 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.273877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.274799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.275557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.275719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.275870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.276918 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.277063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.277231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.277620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.277777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.277923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.278302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.278493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.278649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.278901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.279396 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.279555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.279555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.279842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.279986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.280135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.280297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.280449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.281547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.281760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.281930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.282080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.282080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.282743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.282900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.283935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.284078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.284226 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.284377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.284529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.285154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.285314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.285468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.285670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.285829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.286253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.286453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.286600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.286750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.286895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.287047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.287192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.287344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.287801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.287960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.288113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.288507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.288669 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.288841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289136 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.289880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.290023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.290164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.290346 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.290521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.291360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.291512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.291668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.291830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.291988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.292718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293161 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.293998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.294149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.294299 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.294557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.294712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.294858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295654 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.295971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.296863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.297021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.297166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.297316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.297460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.297640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.298118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.298287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.298695 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.298847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.298998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.299308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.299466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.299466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.299758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.299915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.300852 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301002 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.301946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.302097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.302261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.302593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.302711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.302951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.303410 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.303564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.303728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.303918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.304973 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.305118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.305298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.305473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.305605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.305772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.306043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.306383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.306564 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.306782 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.307117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.307301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.307556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.307744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.308263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.308445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.308928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.309090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.309265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.309527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.309732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.309898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.310058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.311984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.312145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.312330 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.312596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.312756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.312914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.313102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.313266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.313430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.313611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.314692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.314884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.315915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.316066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.316215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.316702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.316865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317522 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317681 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.317868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.318498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.318775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.319166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.319328 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.319519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.319671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.319955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.320770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.321064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.321236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.321394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.321554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.321763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.322048 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.322266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.322541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.322698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.322856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323322 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323678 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.323984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324492 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.324971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.325272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.325429 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.325587 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.325745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.325942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326099 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.326910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.327896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.328059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.328273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.329398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.329567 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.329735 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.329914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.330291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.330588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.330753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.330907 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331217 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.331874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.332851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333318 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.333946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.334914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335522 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.335872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.336140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.336379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.336556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.336718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.336869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.337027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.337187 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.337888 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.338893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.339073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.339669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.339840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.339993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.340169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.340445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.340618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.340778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.340941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341244 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341401 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.341893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342389 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.342873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343335 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.343851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344337 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.344966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.345261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.345261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.345554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.345554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.345873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346226 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.346902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.347985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.348974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.349126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.349647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.349898 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350209 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.350988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.351154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.351306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.351466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.351618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.351778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.352208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.352379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.352541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.352701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.352888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.353674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.353854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354688 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.354849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355318 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.355958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.356311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.356582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.356743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.356743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357514 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.357844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358514 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.358970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.359127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.359295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.359814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.360083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.360083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.360454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.360616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.360887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.361073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.361817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.361995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.362151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.362317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.362553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.362718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.362872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363829 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.363989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.364180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.364349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.364510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.364734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.364939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.365184 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.365367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.365542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.365694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.365846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.366874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.367985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.368150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.368349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.368512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.368755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.368970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.369128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.369365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.370033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.370311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.370311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.370676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.370839 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371280 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.371906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.372926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.373884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.374868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.375981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376644 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376798 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.376967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.377894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.378887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.379050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.379209 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.379375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.379375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.379682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.380198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.380465 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.380625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.380794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.380954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.381126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.381363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.381522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.381725 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.381970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.382971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.383923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.384080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.384266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.384469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.384771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.385872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.386039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.386217 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.386421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.386627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.386792 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.387230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.387393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.387556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.387715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.387874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.388879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.389863 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.391078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.391302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.391585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.391747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.391924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.392872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.393668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.394121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.394274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.394657 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.394818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.394983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.395771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.396933 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.397859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398378 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.398929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399235 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.399698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.401251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.401584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.401854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.402010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.402128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.402254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.402411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.402913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.403119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.403277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.403471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.403714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.403890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.404963 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.405988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.406145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.406371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.406544 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.406698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.407972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.408163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.408362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.408521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.408754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.408942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.409907 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.410068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.410068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.410505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.410505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.411243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.411492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.411651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.411811 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.412955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.413800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.414944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.415104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.415300 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.415489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.416320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.416511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.416718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.416914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417457 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.417920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.418948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.419116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.419379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.419545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.419707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.419707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.420017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.420178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.420329 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.420487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.420726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.422795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.422887 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.422974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.423932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424294 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424858 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.424983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.425931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.426930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.427908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428256 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428488 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428721 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.428948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429326 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.429985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.430988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.431481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.431660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.431880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432378 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.432885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433457 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433579 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.433948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434346 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434835 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.434956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.435926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.436906 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.437102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.437267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.437430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.437684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.437922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.438985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.439273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.439433 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.439629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.439787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.439939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440256 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440733 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.440917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.441074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.441252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.441764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442026 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.442975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.443954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.444944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.445919 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.446970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.447323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.447323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.447323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.447323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.447323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.448871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449217 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.449863 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.450847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.451017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.452546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.452725 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.452909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.453991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.454974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455770 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.455961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.456920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.457956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.458244 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.458419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.458590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.458743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.458894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459526 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.459988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460299 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.460922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461108 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.461957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.463994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.464162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.464333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.464496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.464656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.464815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.465130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.465352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.465548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.465739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.465934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.466123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.466318 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.466546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.466744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.466945 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.467133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.467359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.467570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.467775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.467973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.468168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.468364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.468535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.468698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.468859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469189 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.469986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470289 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.470944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.471105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.472711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.474191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.475403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.476551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.479276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.479276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.479276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 10:23:56.479276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 10:23:56.506030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO dbcounter [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Registered counter for database nova_api Oct 17 10:23:56.520187 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO dbcounter [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Registered counter for database nova_api Oct 17 10:23:56.527748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.534468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writer thread running {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.541134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_db.sqlalchemy.engines [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.547876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writer thread running {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.589568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.context [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66ef73f3-9115-4ace-9509-220fc52b388b(cell1) {{(pid=118679) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 10:23:56.593505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:23:56.593975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:23:56.595593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:23:56.596314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:23:56.596755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:23:56.598762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:23:56.600730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO dbcounter [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Registered counter for database nova_cell0 Oct 17 10:23:56.603700 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.context [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66ef73f3-9115-4ace-9509-220fc52b388b(cell1) {{(pid=118680) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 10:23:56.605080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO dbcounter [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Registered counter for database nova_cell1 Oct 17 10:23:56.607800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:23:56.608280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:23:56.609876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:23:56.610648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:23:56.611103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:23:56.612061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.613157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:23:56.613709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.615222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO dbcounter [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Registered counter for database nova_cell0 Oct 17 10:23:56.619419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO dbcounter [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Registered counter for database nova_cell1 Oct 17 10:23:56.619938 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writer thread running {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.621236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writer thread running {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.626892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_db.sqlalchemy.engines [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.628568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_db.sqlalchemy.engines [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.635028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writer thread running {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.637182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writer thread running {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.768354 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO dbcounter [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Registered counter for database nova_cell0 Oct 17 10:23:56.775583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.780276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writer thread running {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:56.783491 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO dbcounter [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Registered counter for database nova_cell0 Oct 17 10:23:56.790118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_db.sqlalchemy.engines [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 10:23:56.795026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writer thread running {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 10:23:57.101367 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: WARNING keystonemiddleware.auth_token [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:23:57.109185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: WARNING keystonemiddleware.auth_token [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:23:57.113612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: WARNING keystonemiddleware.auth_token [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:23:57.121625 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: WARNING keystonemiddleware.auth_token [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:23:57.456552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: WARNING keystonemiddleware.auth_token [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:23:57.462643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: WARNING keystonemiddleware.auth_token [None req-5ef248dd-e241-4047-8a86-c4562eec6203 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:23:57.467934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557de82e19c0 pid: 118679 (default app) Oct 17 10:23:57.469840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: WARNING keystonemiddleware.auth_token [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 10:23:57.475798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: WARNING keystonemiddleware.auth_token [None req-872e12a3-9706-44f9-bf16-f5b955953ba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 10:23:57.482166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557de82e19c0 pid: 118680 (default app) Oct 17 10:24:34.010990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.011872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.012702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:34.014200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:35.843704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b642e2b4-71e4-493a-b1c4-240ac2a3c013 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Action: 'create', calling method: .version_select at 0x7fe9bb6c44c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1142953257", "metadata": {"Type": "work"}}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:37.624368 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.630191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.634243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.642587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:24:37.853088 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b642e2b4-71e4-493a-b1c4-240ac2a3c013 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.848072 Oct 17 10:24:37.853866 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 10:24:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3851 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 10:24:37.876113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0fc495fe-0d71-44d0-982f-88257af4e70d tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb5993a0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:37.988436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0fc495fe-0d71-44d0-982f-88257af4e70d tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 200 len: 353 microversion: 2.1 time: 0.115930 Oct 17 10:24:37.989343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:37 2022] GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:38.254623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-02f8dbce-0f9e-48c3-b77a-b27a753ce37e tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb711160>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:38.890665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-02f8dbce-0f9e-48c3-b77a-b27a753ce37e tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1912b161-e823-44e5-8d60-4e33e38b6cff" status: 200 len: 350 microversion: 2.1 time: 1.276884 Oct 17 10:24:38.891327 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:37 2022] GET /compute/v2.1/os-volumes/1912b161-e823-44e5-8d60-4e33e38b6cff => generated 350 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:39.004057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ada82289-86c9-4e31-a03f-ea4d06296dc5 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb599a60>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:39.609266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ada82289-86c9-4e31-a03f-ea4d06296dc5 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 200 len: 354 microversion: 2.1 time: 0.608957 Oct 17 10:24:39.610386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:38 2022] GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 354 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:39.626642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f058f75a-51e9-4992-9d49-e6ed1578970b tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb5da3a0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:39.967348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f058f75a-51e9-4992-9d49-e6ed1578970b tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 200 len: 354 microversion: 2.1 time: 0.346470 Oct 17 10:24:39.968344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:39 2022] GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 354 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:39.990789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-95fc3431-8169-4c61-8243-47c295c3ef98 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb532160>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:40.146494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-95fc3431-8169-4c61-8243-47c295c3ef98 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 202 len: 0 microversion: 2.1 time: 0.160620 Oct 17 10:24:40.150314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:24:39 2022] DELETE /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:24:40.157384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b2e2da01-fa65-4f32-97d1-9b79a66136b2 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb5daaf0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:40.266815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b2e2da01-fa65-4f32-97d1-9b79a66136b2 tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 200 len: 353 microversion: 2.1 time: 0.115086 Oct 17 10:24:40.267512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:40 2022] GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:40.925464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e53f09c8-1cac-4355-9ea6-1bdb4ba294d2 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb599d30>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:41.026922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e53f09c8-1cac-4355-9ea6-1bdb4ba294d2 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/57a4ed60-bae4-43a3-8ed0-818024a153bb" status: 200 len: 350 microversion: 2.1 time: 0.105506 Oct 17 10:24:41.027690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:40 2022] GET /compute/v2.1/os-volumes/57a4ed60-bae4-43a3-8ed0-818024a153bb => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:24:41.284505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-989b4c15-69cc-482a-8f4c-4fcff052050f tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Calling method '.version_select at 0x7fe9bb5dad30>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:41.339473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-989b4c15-69cc-482a-8f4c-4fcff052050f tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] HTTP exception thrown: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-989b4c15-69cc-482a-8f4c-4fcff052050f tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Request method failure captured: Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d HTTP/1.1 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1hA2uMG9s7NsiioSwzmDms3ZFFo7GH0j2ga0PGLnmhWs_piqvplcuK1cDMxuBarsysrNGJQSqr_fr6Ho0AnUXp6lQsOAq6oNf7bLZ-giNisReUteoLyPyVWIxNZln3BHTyMhqMe6HFzDjgmgDk72HBTdBZmYQS4dhin59HzVn9XEU Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 9fc4d931061d4aaba3dc577413f06866 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesGetTestJSON-590324857 Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:24:41.344533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fc4d931061d4aaba3dc577413f06866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fc4d931061d4aaba3dc577413f06866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fc4d931061d4aaba3dc577413f06866"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fc4d931061d4aaba3dc577413f06866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesGetTestJSON-590324857 Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 9fc4d931061d4aaba3dc577413f06866 Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesGetTestJSON-590324857 Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesGetTestJSON-590324857-project Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 57f7edfdf0324725aefe7bcc3c10405a Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesGetTestJSON-590324857-project Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'a954cd42-ef70-4814-947d-a7a705d3e76d'} Oct 17 10:24:41.345842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. (HTTP 404) (Request-ID: req-f681928c-33ba-49e9-ae88-74b4bd7bc01c) Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:24:41.346752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:24:41.354618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 10:24:41.357461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-989b4c15-69cc-482a-8f4c-4fcff052050f tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] Returning 404 to user: Volume a954cd42-ef70-4814-947d-a7a705d3e76d could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-989b4c15-69cc-482a-8f4c-4fcff052050f tempest-VolumesGetTestJSON-590324857 tempest-VolumesGetTestJSON-590324857-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d" status: 404 len: 109 microversion: 2.1 time: 0.067651 Oct 17 10:24:41.360043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:41 2022] GET /compute/v2.1/os-volumes/a954cd42-ef70-4814-947d-a7a705d3e76d => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:24:42.731618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-487864f7-4cf6-47a0-84bb-000cd853af9d tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb5994c0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:42.865783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-487864f7-4cf6-47a0-84bb-000cd853af9d tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f85d95b5-d467-4c18-adba-aa1456d27dca" status: 200 len: 350 microversion: 2.1 time: 0.139856 Oct 17 10:24:42.866403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:24:42 2022] GET /compute/v2.1/os-volumes/f85d95b5-d467-4c18-adba-aa1456d27dca => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:42.886754 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a5252c10-256f-4fae-9bbb-3eb88e9bcd23 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bbef2a60>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:43.151124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a5252c10-256f-4fae-9bbb-3eb88e9bcd23 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.272918 Oct 17 10:24:43.152148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 17 10:24:42 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:43.167650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6d497bda-b3e8-4283-84bf-ba29ad372423 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb5323a0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:43.343483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6d497bda-b3e8-4283-84bf-ba29ad372423 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180097 Oct 17 10:24:43.354137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 17 10:24:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:43.358920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-297801d6-86c7-456d-845c-fa2cef70b53f tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb4fd790>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:43.545687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-297801d6-86c7-456d-845c-fa2cef70b53f tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.190535 Oct 17 10:24:43.554677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 17 10:24:43 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:24:43.560851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-178f1231-39c1-45ea-8ae9-fb41d1cc40a8 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb599550>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:43.744069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-178f1231-39c1-45ea-8ae9-fb41d1cc40a8 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187314 Oct 17 10:24:43.744943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 17 10:24:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:24:43.758285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2a342dff-e20b-4ead-b011-5ef606fe01bf tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bbef2940>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:43.958628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2a342dff-e20b-4ead-b011-5ef606fe01bf tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.203994 Oct 17 10:24:43.959250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 17 10:24:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:43.973784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-28dd5479-7670-4808-b280-b3cdedf6e8c1 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb5328b0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:44.229545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-28dd5479-7670-4808-b280-b3cdedf6e8c1 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.259139 Oct 17 10:24:44.241669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 17 10:24:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:44.256817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e43b7e82-7f62-4a9b-a84a-6bdfe6b41676 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb50d790>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:44.451814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e43b7e82-7f62-4a9b-a84a-6bdfe6b41676 tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.211846 Oct 17 10:24:44.453324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 17 10:24:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:44.468711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c6dc0f15-1e16-45f8-864c-e1598c0e50fa tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] Calling method '.version_select at 0x7fe9bb50d820>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:44.634514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-528547184", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:44.688979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c6dc0f15-1e16-45f8-864c-e1598c0e50fa tempest-VolumesTestJSON-739007255 tempest-VolumesTestJSON-739007255-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.224154 Oct 17 10:24:44.689651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 17 10:24:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:24:44.894411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] validate_networks() for [('ec16a399-207c-4cf6-8c2e-ca17cef7b669', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:24:47.236911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:24:47.237544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:24:47.238045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:24:47.238585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:24:47.239270 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:24:47.276260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:47.277936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:47.280720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:47.284321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:47.285090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:47.286896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:47.345502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:24:47.364682 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for user aaedb0e1920a42eb97e8dc2f3ec76905 and project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:24:47.385854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:24:47.408538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:24:47.589524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3003a752-dc4b-4f6b-85ff-1a67e980eeba tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.183355 Oct 17 10:24:47.590189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 10/19] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:24:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 10:24:47.605431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1779d485-b4f0-4e8d-97e8-513b14a06c12 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:47.606192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1779d485-b4f0-4e8d-97e8-513b14a06c12 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:48.037638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1779d485-b4f0-4e8d-97e8-513b14a06c12 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:48.151482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1779d485-b4f0-4e8d-97e8-513b14a06c12 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1221 microversion: 2.1 time: 0.534822 Oct 17 10:24:48.152139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 10/20] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:47 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1221 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:48.706520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2066492191", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:48.906027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] validate_networks() for [('ec16a399-207c-4cf6-8c2e-ca17cef7b669', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:24:51.289008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:24:51.290168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:24:51.291444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:24:51.291965 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:24:51.292631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:24:51.326933 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:51.327733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:51.328428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:51.329408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:51.330620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:51.332081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:51.361501 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:24:51.371090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for user aaedb0e1920a42eb97e8dc2f3ec76905 and project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:24:51.436246 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:24:51.449945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:24:51.527457 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-172172026", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "networks": [{"uuid": "46924aeb-cbea-4ee4-b8a7-97f1f0d41daf"}]}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:51.564055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-eb0640f7-299a-4cf2-bce1-17b2cade5a45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.863552 Oct 17 10:24:51.577444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 11/21] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:24:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:24:51.779737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-367bf3eb-6256-4bad-a3b1-ae1c08f2f72a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: .version_select at 0x7fe9bac4bb80>, body: {"keypair": {"name": "tempest-keypair-1788114868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7mE2VN2Acynf1edtyeS8oYozU78w5qVOm2ri1HfPSJfRqwDhNiHCVLIoS+1E/lDwvUvy7HIJq6meibO5g39MSDCvO/75R25meRsThg1W5DGZSaWIYbJlTlPr2k6Q80Mg=="}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:51.855591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-367bf3eb-6256-4bad-a3b1-ae1c08f2f72a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:24:51.858821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] validate_networks() for [('46924aeb-cbea-4ee4-b8a7-97f1f0d41daf', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:24:51.865896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-367bf3eb-6256-4bad-a3b1-ae1c08f2f72a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:24:51.935832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-367bf3eb-6256-4bad-a3b1-ae1c08f2f72a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361725 Oct 17 10:24:51.936453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 12/22] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:24:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:24:51.944717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-25f5355b-ad66-489b-8142-9e41e4658054 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:51.944924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-25f5355b-ad66-489b-8142-9e41e4658054 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:52.302571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-25f5355b-ad66-489b-8142-9e41e4658054 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:52.332746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-25f5355b-ad66-489b-8142-9e41e4658054 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1222 microversion: 2.1 time: 0.395205 Oct 17 10:24:52.336492 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:51 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1222 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:53.362548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d6c7c876-8e97-4c06-b7f2-b2ae17c1a66b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:53.364201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d6c7c876-8e97-4c06-b7f2-b2ae17c1a66b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:53.784569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d6c7c876-8e97-4c06-b7f2-b2ae17c1a66b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:53.795283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d6c7c876-8e97-4c06-b7f2-b2ae17c1a66b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1222 microversion: 2.1 time: 0.435934 Oct 17 10:24:53.796488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 14/24] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:53 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:24:54.627930 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:24:54.628406 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:24:54.628809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:24:54.629215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:24:54.629617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:24:54.686039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:54.687114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:54.689616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:54.690696 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:54.693880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:54.694613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:54.744386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Getting quotas for project 6e2cba05193f429fb9ffef6f66205945. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:24:54.770639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Getting quotas for user ca96437c5fdc4c1ba41ca7960813dfae and project 6e2cba05193f429fb9ffef6f66205945. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:24:54.807251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:24:54.823087 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:24:54.826262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c374e4b3-d9ec-4525-9e81-5027a4c39619 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: .version_select at 0x7fe9bac1f280>, body: {"keypair": {"name": "tempest-keypair-1372430957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsGhacOIdDGwi+1v92YzhESIclsbOqIp29wg9hPUjbWj+BOgBsX3fNhunEcDXKJ6/koo2pXMsqOPmLEuFdSGzMwv/ZG9rGrh70MdF0NWs0j5WOQfc8XgSc8ulihKb7seQ=="}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:24:54.885406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-c374e4b3-d9ec-4525-9e81-5027a4c39619 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:24:54.896222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-c374e4b3-d9ec-4525-9e81-5027a4c39619 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for user eb7c6da9fd3c4b72a687daa923d07918 and project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:24:54.950867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c374e4b3-d9ec-4525-9e81-5027a4c39619 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.765454 Oct 17 10:24:54.958447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 15/25] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:24:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:24:54.975927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:54.978107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:54.996003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:54.999944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:55.000753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:55.001727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:55.004793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:55.009613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:55.143254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6ce93268-d41a-4df6-bf84-bbecee9dfc66 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.124566 Oct 17 10:24:55.144418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 11/26] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:24:55.162961 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7584a333-fa21-4709-8434-cdb507ee4bea tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:55.165896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7584a333-fa21-4709-8434-cdb507ee4bea tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:55.389097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:55.416274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cfd0f79b-587c-4251-ae2b-f5845ec47d00 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1226 microversion: 2.1 time: 0.446669 Oct 17 10:24:55.416469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7584a333-fa21-4709-8434-cdb507ee4bea tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:55.417535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 16/27] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:54 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1226 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:55.440491 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7584a333-fa21-4709-8434-cdb507ee4bea tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1214 microversion: 2.1 time: 0.287340 Oct 17 10:24:55.446016 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 12/28] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:55 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:56.442592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:56.443210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:56.466570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:56.468573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:56.469316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:56.470878 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:56.471501 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:56.472849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:56.475769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:56.476243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:56.488592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:56.499741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:56.500437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:56.506557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:56.507378 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:56.507868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:56.702787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:56.712842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d463ab9d-a1b1-49e9-8731-22e188f2be1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1226 microversion: 2.1 time: 0.276598 Oct 17 10:24:56.717837 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:56 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1226 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:57.273232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:57.303277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d68b1172-0bd7-47f8-bebb-143d46e416f1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1218 microversion: 2.1 time: 0.839164 Oct 17 10:24:57.323319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 13/30] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:56 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1218 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:24:57.737827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:57.738467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:57.746796 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:57.754845 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:57.761063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:57.761912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:57.762284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:57.768806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:58.067935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:58.094315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-90b82055-1c6f-4709-b5cd-956b55f17f60 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1218 microversion: 2.1 time: 0.360310 Oct 17 10:24:58.096479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 18/31] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:57 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:58.337350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:58.340992 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:58.366306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:58.366885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:58.368448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:58.376730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:58.377415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:58.378012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:58.547196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:58.555452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d4fba1e7-aff0-415a-9dc9-30f1580581ba tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1210 microversion: 2.1 time: 0.226788 Oct 17 10:24:58.563172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 14/32] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:58 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1210 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:24:59.119343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:59.120630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:59.154352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:59.155107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:59.155597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:59.156368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:59.156839 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:59.157312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:59.588106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:24:59.589373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:24:59.603937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:59.604972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:59.605723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:59.606881 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:24:59.609266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:24:59.615749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:24:59.807911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:24:59.816187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8f4a57c6-3bd8-4615-b15a-bf1e9ac56f45 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1282 microversion: 2.1 time: 0.700961 Oct 17 10:24:59.820043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 19/33] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:59 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1282 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:00.070920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:00.079181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-22b186c8-32da-42e0-b9bc-65c07b0ea9a4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1266 microversion: 2.1 time: 0.495373 Oct 17 10:25:00.102856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 15/34] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:24:59 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1266 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:00.579193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2147062496", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec7b89aa-8615-42a5-9a24-4f31d3ebca8d"}], "security_groups": [{"name": "tempest-securitygroup--227171904"}], "key_name": "tempest-keypair-1372430957", "user_data": "}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:00.855458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:00.856706 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:00.887803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:00.899685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:00.901511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:00.905371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:00.906599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:00.909254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:01.346788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=4 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:01.671084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:01.692487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-67c0d8a9-72d3-46a4-836a-79f0838f3a7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1280 microversion: 2.1 time: 0.840594 Oct 17 10:25:01.693162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:00 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1280 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:01.716100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:01.717864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:01.747653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:01.748196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:01.751684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:01.752476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:01.756498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:01.758673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:02.114427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] validate_networks() for [('ec7b89aa-8615-42a5-9a24-4f31d3ebca8d', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:25:02.158119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:02.175359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3adf187b-0659-4cdb-ab4c-3ce40b42c7af tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1272 microversion: 2.1 time: 0.476662 Oct 17 10:25:02.202004 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 17/36] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:01 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:02.220088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1698647064", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad62b422-f6a9-44d6-866f-37a78f2fcbac"}], "security_groups": [{"name": "tempest-securitygroup--814994982"}], "key_name": "tempest-keypair-1788114868", "user_data": "}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:02.660580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] validate_networks() for [('ad62b422-f6a9-44d6-866f-37a78f2fcbac', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:25:04.374029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:25:04.374575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:25:04.374890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:25:04.375544 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:25:04.376218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:25:04.421832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:04.425150 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:04.427401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:04.428682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:04.430892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:04.432290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:04.546419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:25:04.565735 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:25:04.645866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:25:04.667590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:25:04.910611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=24 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:04.922250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a9136da7-1ca7-4f3d-9cbf-bafe257eda1a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.717579 Oct 17 10:25:04.926351 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:25:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:25:04.963521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:04.966425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:04.981914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:25:04.982353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:25:04.982927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:25:04.983511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:25:04.983964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:25:05.026132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.026734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.026853 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.027194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.027628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.029326 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.033829 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.034708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.037785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.038007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.041613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.045553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.172683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:25:05.196915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for user eb7c6da9fd3c4b72a687daa923d07918 and project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:25:05.243067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:25:05.249151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:25:05.371422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-935278b4-0ab2-4549-9fda-4db6ca3cdbe8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.797641 Oct 17 10:25:05.374677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:25:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 4801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:25:05.403920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:05.410887 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:05.431564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.432307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.433068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.443894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:05.448534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:05.449449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:05.456005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:05.474021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b8b34385-fbd4-4122-8ac4-1b5753fc5e3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1280 microversion: 2.1 time: 0.542060 Oct 17 10:25:05.476857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:04 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1280 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:06.347032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a35982-9d23-4588-965f-96ea10757f72", "tag": "f398f903-fded-4efd-b6f3-7b669ec7ccce"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:06.402926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:06.404597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:06.405631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:06.435445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Creating event network-changed:f398f903-fded-4efd-b6f3-7b669ec7ccce for instance b0a35982-9d23-4588-965f-96ea10757f72 on hv-cinder-86020 Oct 17 10:25:06.436261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 10:25:06.436828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-70d7cb1d-fd86-4d2d-98ff-945801227872 req-60bad501-950d-4823-b702-7857f4a39847 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 10:25:06.438051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:06.439270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:06.439873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:06.442007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:06.442695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:06.443550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:06.456316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.compute.rpcapi [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 10:25:06.458013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 10:25:06.483655 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d2df2999-ccb1-4f6b-94d3-1dd035e761f7 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.003847 Oct 17 10:25:06.484993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 20/40] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:06.503752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5fb3a2c2-a2e0-4db2-b897-f55211a49369 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:06.504734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5fb3a2c2-a2e0-4db2-b897-f55211a49369 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:06.984105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5fb3a2c2-a2e0-4db2-b897-f55211a49369 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:06.994475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5fb3a2c2-a2e0-4db2-b897-f55211a49369 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1242 microversion: 2.1 time: 0.506846 Oct 17 10:25:07.013911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:06 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1242 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:07.033410 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:07.034042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:07.061967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:07.062500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:07.062943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:07.063661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:07.064142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:07.064603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:07.471326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:07.483254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3e3b51d9-57e0-49d1-9325-5dd55968808c tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 2.105214 Oct 17 10:25:07.490126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:05 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:07.511777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:07.512421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:07.545924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:07.546828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:07.547530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:07.549383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:07.550235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:07.552754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:07.884188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:07.892888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9de53e52-70ac-480f-92b0-5bf642ec3e23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1242 microversion: 2.1 time: 0.877766 Oct 17 10:25:07.893472 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:07 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1242 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:08.020974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:08.021598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:08.035674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.035674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.038303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:08.039709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.040174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.042823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:08.307195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:08.323478 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0df1047b-dfae-4ea3-82a0-4e407cb856bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1294 microversion: 2.1 time: 0.306216 Oct 17 10:25:08.328797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 23/44] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:08 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:08.513716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:08.514546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:08.517194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:08.569415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.573737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.574584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:08.585790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.590736 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.592575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:08.605779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:08.640170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ce60bbd4-b8c6-4f6f-8c79-583d4d6c50b9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 1.140625 Oct 17 10:25:08.642294 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 22/45] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:07 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:08.920559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:08.921226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:08.932329 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.932872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.933438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:08.934106 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:08.957505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:08.976749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:09.349966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:09.368990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-624b8294-0218-4592-ad5c-dbc8ea25d41f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1234 microversion: 2.1 time: 0.446739 Oct 17 10:25:09.378617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 23/46] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:08 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1234 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:09.389192 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:09.396815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:09.421271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:09.427320 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:09.429079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:09.430174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:09.431967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:09.433968 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:09.838822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:09.847049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c046e5e7-5ac0-453c-a602-f072379c9af4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1302 microversion: 2.1 time: 0.466864 Oct 17 10:25:09.858292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 24/47] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:09 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1302 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:09.863358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:09.874935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:09.878160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:09.926801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:09.928732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:09.929256 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:09.941136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:09.941688 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:09.942137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:10.263292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:10.275897 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-11c9c018-bc4e-46b8-bbd3-2366009c411d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 1.764584 Oct 17 10:25:10.286681 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:08 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:10.404349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:10.405206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:10.423951 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:10.424739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:10.425385 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:10.426287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:10.426942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:10.427548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:10.703361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:10.726642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-08aed3e6-1687-4e6a-99b3-bf8a5141b182 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1290 microversion: 2.1 time: 0.325853 Oct 17 10:25:10.729033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 25/49] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:10 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1290 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:10.884771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:10.885885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:10.893419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:10.902000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:10.902835 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:10.904051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:10.906105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:10.907317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:11.057757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:11.067221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ee5d7d86-e046-45a2-afed-7af16196fd3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 1.207679 Oct 17 10:25:11.081604 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 25/50] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:09 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:11.177829 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:11.195784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c936197c-3aea-4c79-9a97-52addcfcc795 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1300 microversion: 2.1 time: 0.314974 Oct 17 10:25:11.196696 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 26/51] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:10 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1300 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:11.308323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:11.309675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:11.332367 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:11.334973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:11.338055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:11.341428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:11.343023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:11.344741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.134764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daff838-b032-48a4-bcaa-413c56fc7824", "tag": "35980f72-8911-433f-8989-708b4cfffccb"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:12.158065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:12.160286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.163493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.166158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.175277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-09c722d1-783e-45f3-9b8a-6903b668439e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.869437 Oct 17 10:25:12.175943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:11 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:12.193945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:12.194761 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:12.207790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] Creating event network-changed:35980f72-8911-433f-8989-708b4cfffccb for instance 9daff838-b032-48a4-bcaa-413c56fc7824 on hv-cinder-86020 Oct 17 10:25:12.215693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.216893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.217578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.219103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-143fba46-c2a5-4975-b65b-f07db8f3227c req-0ccf1267-d792-4bf8-86ce-95660ac91f67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.685046 Oct 17 10:25:12.220844 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.221184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 27/53] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:12.222946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.224328 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.233172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:12.233872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:12.251989 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.252775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.255861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.257449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.260535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.261535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.437314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:12.447180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-70c80dfb-59e7-4d1f-b73d-0fbfeac6b005 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1308 microversion: 2.1 time: 0.270034 Oct 17 10:25:12.465726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:12 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:12.479270 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:12.479903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:12.487829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.489189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.490171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.490951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.491401 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.491858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.728011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:12.739495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c4083d1a-abb1-4fec-aba1-e1dfd4cb6d16 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.513476 Oct 17 10:25:12.756760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:12 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:12.856245 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2dfd38-7528-4af3-88c5-86afe10123b8", "tag": "8b16d3ef-463a-486f-a242-f0bc1977b822"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:12.866548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:12.867575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:12.868014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:12.868727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:12.878900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-49eff137-6da9-46e7-9a7d-086de08be413 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.408882 Oct 17 10:25:12.880051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] Creating event network-changed:8b16d3ef-463a-486f-a242-f0bc1977b822 for instance fc2dfd38-7528-4af3-88c5-86afe10123b8 on hv-cinder-86020 Oct 17 10:25:12.885307 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-2861c98a-1b3e-44f4-aefc-4a53420eea21 req-3cba7417-f1b9-470a-b68d-6bb4cc2caa5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036450 Oct 17 10:25:12.886159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:12.887139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 28/57] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:12 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:13.201987 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:13.202614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:13.213917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.214731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.215362 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.216109 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.226941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.227855 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.449496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:13.461797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-95d961f2-8f20-4813-bb02-a9c3818108d7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.266027 Oct 17 10:25:13.474553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:13 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:13.479114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:13.479457 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:13.493529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.494028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.496905 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.499987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.502261 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.502767 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.575025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:13.583176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d1983959-b7fe-498b-a2f4-8d8631fc6672 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1308 microversion: 2.1 time: 0.110091 Oct 17 10:25:13.583982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:13 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:13.766431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:13.767046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:13.773029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.773598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.774065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.774771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.775224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.775646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.902539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:13.902539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:13.910569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.910569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.910569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:13.910936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:13.911406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:13.911830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:14.191924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:14.194563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=89 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:14.203326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e4650008-9496-4c6b-a4d5-837896f69401 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.305440 Oct 17 10:25:14.215341 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 30/60] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:13 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:14.354419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:14.362762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8b8f7aac-5dec-47f8-8a54-59d236c998bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.600123 Oct 17 10:25:14.365121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:13 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:14.486593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:14.487202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:14.498754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:14.499315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:14.499790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:14.500550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:14.501043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:14.501524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:14.609977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:14.610623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:14.627394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:14.628640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:14.629283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:14.630464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:14.632220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:14.633098 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:14.667259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:14.713098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:14.721279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4dd62a3f-fa94-4b70-9bd5-66be7ec3a623 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.239777 Oct 17 10:25:14.724091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:14 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:14.769134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:14.784458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-23395ce6-1179-454e-a7fd-bfb79a52610d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1296 microversion: 2.1 time: 0.178404 Oct 17 10:25:14.791631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:14 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1296 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:15.230667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:15.231803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:15.236356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:15.237176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:15.244512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.245821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.246641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.247660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.248534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.249201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.279777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd552f-1059-4d09-a797-ac62de74b383", "tag": "05903ad8-a4e1-4f5e-afb2-0494b0e2bc16"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:15.313208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.313704 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.314144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.343093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] Creating event network-changed:05903ad8-a4e1-4f5e-afb2-0494b0e2bc16 for instance e0dd552f-1059-4d09-a797-ac62de74b383 on hv-cinder-86020 Oct 17 10:25:15.354198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-a695617d-c734-4d29-8a85-579eea5dad97 req-dac8a11b-a049-41ad-b2fc-3b69af1d8225 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081753 Oct 17 10:25:15.355166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 33/64] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:15.399966 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:15.401232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:15.410638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.411156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.411684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.412967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.413610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.415030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.419046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:15.427926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ef9a309d-295e-4565-9e92-602d6b0bbddb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.203024 Oct 17 10:25:15.428959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:15 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:15.572985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:15.583433 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b7bfd565-038a-48de-bf4c-be4b4aed357e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.199258 Oct 17 10:25:15.584419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:15 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:15.749873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:15.751161 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:15.758939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.759614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.760059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.760874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.761323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.761744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.811615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:15.812604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:15.821125 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.822146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.823064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.824226 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:15.825589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:15.826309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:15.912667 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:15.937809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c4f03bbc-9332-4cf9-a543-77d3fb359568 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1296 microversion: 2.1 time: 0.124750 Oct 17 10:25:15.937809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 35/67] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:15 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1296 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:15.953647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:15.962899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d9235dfd-8a2d-4a95-8eec-df14285513cc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.217426 Oct 17 10:25:15.963839 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 33/68] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:15 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:16.454430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:16.455037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:16.457232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:16.463347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.463915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.464605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:16.465622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.466094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.466786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:16.609510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:16.610550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:16.617711 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.618705 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.619366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:16.620610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.621265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.622003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:16.740910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:16.749505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b99a0d85-8af1-4abc-b3fc-106ee2d9dae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.299963 Oct 17 10:25:16.754203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:16 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:16.957001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:16.957608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:16.965844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.966355 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.970154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:16.971101 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:16.971490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:16.971911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:17.024373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=18 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:17.109719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:17.118383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0e83d718-0b98-4bc9-ae33-bcbbf1336a1f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1296 microversion: 2.1 time: 0.164689 Oct 17 10:25:17.118977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 37/70] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:16 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:17.131692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:17.132314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:17.153810 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:17.154380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:17.154834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:17.155555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:17.156003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:17.156618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:17.505250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:17.524635 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bc124318-22bd-4213-a87a-8c1b398b9ecd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.919126 Oct 17 10:25:17.526433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 34/71] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:16 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:17.777917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:17.778820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:17.787165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:17.787650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:17.788118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:17.789612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:17.790233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:17.790568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:17.848028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:17.859238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2577dc26-84e1-48e5-8120-09d15c96482b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.739045 Oct 17 10:25:17.888190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:17 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:18.114834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:18.146908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:18.149557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:18.156530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.158538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.159292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:18.160234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.161024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.161646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:18.170376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-84174b5d-ed53-4e74-bda2-b454e3b8f5d7 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.397063 Oct 17 10:25:18.174992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 35/73] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:17 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:18.488352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:18.501205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b42d6b6c-018b-4af5-9b7b-eea054282acb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1296 microversion: 2.1 time: 0.356681 Oct 17 10:25:18.502059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 39/74] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:18 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1296 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:18.559154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:18.561210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:18.573520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.574481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.576262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:18.578134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.579459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.580793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:18.852090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:18.870275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bfc70b5a-c060-483c-8612-7ca0fa6cad73 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.319247 Oct 17 10:25:18.871938 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 36/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:18 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:18.896020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:18.897705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:18.907768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.908671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.909551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:18.910756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:18.911617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:18.912353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.118757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:19.129590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c01050c3-4db1-4217-aef3-9f7d747fb433 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.242450 Oct 17 10:25:19.135873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:18 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:19.197917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:19.198994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:19.215190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.216800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.219160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.220128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.222672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.223609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.533327 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:19.534246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:19.557462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.563011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.563486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.566816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.567313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.569340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.588745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:19.604279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f5bb179a-68dc-42b6-8da6-8e89ab0cc166 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.410880 Oct 17 10:25:19.606163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 37/77] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:19 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:19.865673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:19.874912 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-faa5cb9b-a927-4651-b4e7-26587a84160b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.351602 Oct 17 10:25:19.875953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 41/78] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:19 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:19.894749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:19.896146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:19.905613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.906601 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.907452 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:19.908581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:19.909289 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:19.909843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.122817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:20.131921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-827be517-f40c-4bf6-afee-881df8cc28fa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.241871 Oct 17 10:25:20.148895 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 38/79] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:19 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:20.159047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:20.159713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:20.166882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.167399 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.167864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.168595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.169175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.169612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.464937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:20.473500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-22571b87-209e-492f-a5c4-81ad8b959c13 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.319407 Oct 17 10:25:20.474084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 42/80] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:20 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:20.634700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:20.635326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:20.646879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.650122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.651621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.652370 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.652841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.656489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.902541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:20.903377 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:20.914107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.915283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.916345 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.917480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:20.918344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:20.918995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:20.919107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:20.937674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e7b2d4ba-226d-4e08-9228-5795acebd8d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.310351 Oct 17 10:25:20.938659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 39/81] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:20 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:21.160570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:21.162582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:21.175836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.176812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.178427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.182285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.183076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.184801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.296393 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:21.305758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b41a9af5-837e-424a-9122-367acebf4fbe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.411676 Oct 17 10:25:21.308880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 43/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:20 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:21.467301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:21.480967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-aa7918f1-8d92-4197-9282-8cf5313a2942 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.326108 Oct 17 10:25:21.482120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 40/83] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:21 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:21.505147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:21.506562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:21.518584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.519383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.520016 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.530553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.532520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.532978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.574652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1f19cb-20df-4e33-810d-5e2ced70ef28", "tag": "1195ec6d-7c1a-4c0b-92b5-beb07772c367"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:21.594842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.595323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.595744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.623099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Creating event network-changed:1195ec6d-7c1a-4c0b-92b5-beb07772c367 for instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 on hv-cinder-86020 Oct 17 10:25:21.623899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 10:25:21.624600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2c14c69f-2796-41ec-b2f3-44b7f460dd96 req-c41a4685-0e52-48f3-8c2f-ddd682213481 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 10:25:21.626262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.626893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.627662 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.628922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.629731 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.630345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.642127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.compute.rpcapi [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 10:25:21.643774 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] Releasing lock "compute-rpcapi-router" {{(pid=118679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 10:25:21.662890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-598b3556-7e45-4e34-9eb3-596bbf0a1822 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091641 Oct 17 10:25:21.664246 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 41/84] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:21.733612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:21.743927 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-49328672-2444-4b0f-b3c3-9cbc070fa0b1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.244853 Oct 17 10:25:21.744899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 44/85] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:21 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:21.963027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:21.963807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:21.976137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.977739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.979190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:21.980254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:21.981112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:21.982392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.186961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:22.197882 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-27765168-54d6-428e-89c9-864f41a1ab8f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.239278 Oct 17 10:25:22.201147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:21 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:22.336170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:22.336867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:22.355844 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.356407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.362618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.363513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.364003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.364443 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.625783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:22.637483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-89bc1f7a-d2d2-4164-9265-0a470a4cca87 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.305531 Oct 17 10:25:22.646384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:22 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:22.646384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:22.646384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:22.648676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a35982-9d23-4588-965f-96ea10757f72", "name": "network-vif-plugged", "status": "completed", "tag": "f398f903-fded-4efd-b6f3-7b669ec7ccce"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:22.655736 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.656128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.656791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.657898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.658756 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.659346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.669253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.670086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.670867 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.685651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] Creating event network-vif-plugged:f398f903-fded-4efd-b6f3-7b669ec7ccce for instance b0a35982-9d23-4588-965f-96ea10757f72 on hv-cinder-86020 Oct 17 10:25:22.694755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-6ad3f07a-bb88-465d-9779-27e5651299fe req-2b3d037e-e96a-4995-b132-a8f5ce75088d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549173 Oct 17 10:25:22.695881 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 45/88] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:22.775321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:22.777751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:22.799082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.799591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.800115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.805241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:22.805868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:22.806348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:22.911464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:22.921510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-22f1b156-e442-48f0-b803-817b12736064 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.281863 Oct 17 10:25:22.923708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:22 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:23.227018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:23.229083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:23.244974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.247125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.247610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:23.248371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.249384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.249823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:23.489986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:23.499223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ed5a63cd-d289-45e3-af64-f5bc9cf61dd3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.277893 Oct 17 10:25:23.499808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:23 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:23.639182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:23.650219 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9181998f-7a4d-494c-9229-e1e5dd1c40e5 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.886003 Oct 17 10:25:23.651548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 46/91] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:22 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:23.661248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:23.662462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:23.671235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.672286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.672819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:23.673810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.674386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.675055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:23.949429 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:23.950353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:23.959170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.961639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.964223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:23.967855 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:23.969529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:23.970155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.036917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:24.052902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2381c85b-7cb3-4a84-b85f-331d40a270c3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.394637 Oct 17 10:25:24.068987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 46/92] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:23 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:24.285387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:24.295160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1295a808-46f0-4484-bf70-d90d72dc3ef0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.349369 Oct 17 10:25:24.303425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 47/93] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:23 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:24.526853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:24.527908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:24.537636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:24.539306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:24.540010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.541245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:24.541860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:24.542542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.675734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:24.677409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:24.691768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:24.693345 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:24.694891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.699041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:24.701125 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:24.702710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.839117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:24.841453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:24.855683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1c5aa5fa-1d1f-466a-9fde-80542b96c46f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.329578 Oct 17 10:25:24.870354 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 47/94] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:24 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:24.870354 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2dfd38-7528-4af3-88c5-86afe10123b8", "name": "network-vif-plugged", "status": "completed", "tag": "8b16d3ef-463a-486f-a242-f0bc1977b822"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:24.887076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:24.887570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:24.888005 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:24.902379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] Creating event network-vif-plugged:8b16d3ef-463a-486f-a242-f0bc1977b822 for instance fc2dfd38-7528-4af3-88c5-86afe10123b8 on hv-cinder-86020 Oct 17 10:25:24.908320 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-2a77e5c2-9036-4405-8d3f-226605c2c02f req-1a89a2d4-1c8a-450d-8899-39979df7f4d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050304 Oct 17 10:25:24.909384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 48/95] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:24.982095 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:24.993168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0837815b-44f5-4840-9c3c-e93f609c1ae4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.321154 Oct 17 10:25:24.994370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 48/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:24 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:25.078750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:25.079820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:25.093173 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.096468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.096974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:25.097763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.098221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.100163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:25.270805 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:25.279151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-61b4fd6f-715d-409b-8497-c418fbde0aa8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.205425 Oct 17 10:25:25.279730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 49/97] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:25 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:25.325302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:25.325905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:25.332092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.332583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.333020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:25.333729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.334441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.335088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:25.514288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:25.528796 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4905c733-0128-435a-b086-c17c1345fc68 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.207177 Oct 17 10:25:25.529488 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:25 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:25.881179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:25.882935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:25.891302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.891790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.892228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:25.892937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:25.893467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:25.893908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.020570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:26.021195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:26.029942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.039738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.040937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.042059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.042658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.043110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.080849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:26.084726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:26.095041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-98e8c60f-67d9-436a-9f2d-80b4a7ba98a6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.217154 Oct 17 10:25:26.095717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:25 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:26.243876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:26.253315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-84e30725-7149-410d-9f6d-47772c7532bf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.240520 Oct 17 10:25:26.253965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:26 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:26.302029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:26.302661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:26.309404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.309829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.310271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.311002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.311456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.312156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.554113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:26.555663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:26.563709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.564484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.567031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.568184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.570103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.571112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.671853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:26.681717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5276d39f-0464-40c6-8459-e54fd130c224 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.383337 Oct 17 10:25:26.694350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:26 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:26.751135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:26.760667 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4bab8168-0fe6-4e2c-8e5b-1cbdc78a4898 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.211387 Oct 17 10:25:26.761676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 51/102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:26 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:26.927731 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daff838-b032-48a4-bcaa-413c56fc7824", "name": "network-vif-plugged", "status": "completed", "tag": "35980f72-8911-433f-8989-708b4cfffccb"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:26.938602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:26.939079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:26.939614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:26.952165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] Creating event network-vif-plugged:35980f72-8911-433f-8989-708b4cfffccb for instance 9daff838-b032-48a4-bcaa-413c56fc7824 on hv-cinder-86020 Oct 17 10:25:26.958539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-977b6284-9e7c-4233-8fee-523f8cbc2fa7 req-a75ab91d-632b-47be-9e2b-92996a791af7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033344 Oct 17 10:25:26.958539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 52/103] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:27.121141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:27.122672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:27.131875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.133551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.134514 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.136273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.137204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.137911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.278874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:27.280058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:27.292160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.294884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.295530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.296324 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.296785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.300526 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.365470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:27.377846 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8c4f1f21-d63b-45ae-b03c-2c097d07b1da tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.262875 Oct 17 10:25:27.379026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:27 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:27.518570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:27.527098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2e43b953-2b5c-485d-93c1-3e8e48b887ee tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.253445 Oct 17 10:25:27.527674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 53/105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:27 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:27.707254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:27.708012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:27.715021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.719691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.720055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.720873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.721336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.721756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.783718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:27.784616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:27.796790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.796790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.796790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.796790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:27.797160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:27.797160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:27.949236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:27.958057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-775cc5f7-a2c2-4965-a154-c25f6bb42448 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.254657 Oct 17 10:25:27.963568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 53/106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:27 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:27.983557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:27.992807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-829e691b-5e80-492f-89fd-997a9040155c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.213370 Oct 17 10:25:27.993873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 54/107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:27 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:28.401475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:28.402647 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:28.408223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.408676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.409231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:28.409883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.410364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.410726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:28.552032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:28.552964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:28.560072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.560914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.561436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:28.562371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.563056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.563689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:28.670115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:28.678463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e7851d97-c10d-4fc8-9f47-425bd57e70ce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.281443 Oct 17 10:25:28.680656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 54/108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:28 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:28.770517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:28.778424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dd4b2916-82e7-48c0-afda-54a02af62ae7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.230470 Oct 17 10:25:28.779224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 55/109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:28 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:28.984421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:28.985131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:28.991355 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.992022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.992533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:28.993360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:28.993883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:28.994430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.015923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:29.017098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:29.024382 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.025077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.025781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.026716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.027352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.027981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.170621 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:29.179843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1c6c1607-fc1e-43db-a217-659766ee5059 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.198782 Oct 17 10:25:29.180729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 55/110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:28 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:29.210032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:29.220090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-142ae1a4-99dc-43d1-8be1-02801c960afb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.207888 Oct 17 10:25:29.221377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 56/111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:29 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:29.703997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:29.704691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:29.712017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.713034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.713476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.714455 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.715344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.716043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.805401 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:29.806107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:29.817523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.818013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.818475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.819172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:29.820427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:29.820568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:29.905719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:29.915086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-58cd3b91-22a5-4087-9917-7bc82581f9c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.215007 Oct 17 10:25:29.916797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 56/112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:29 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:29.984885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:29.993419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-58c2db0a-1ae7-484f-a06a-009d849e5219 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.192430 Oct 17 10:25:29.994147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 57/113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:29 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:30.204164 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:30.207084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:30.220391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.221193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.221959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:30.223192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.224080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.224664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:30.247398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:30.250314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:30.257865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.267981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.268664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:30.270784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.271407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.271980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:30.441724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:30.451022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cce09b39-6674-4ade-8919-0c435a13cc49 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.210109 Oct 17 10:25:30.451595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:30 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:30.489151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:30.505683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-514c84e3-dffa-407e-8b49-539cefe1c275 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.305280 Oct 17 10:25:30.506842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 57/115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:30 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:30.939313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:30.939921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:30.946565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.947048 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.947476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:30.948156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:30.948604 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:30.949034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.020537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:31.021285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:31.027765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.028601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.029201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.030196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.030890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.032075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.103163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:31.113207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d142ab0d-f103-44f9-ac19-188c4bad9e95 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.177416 Oct 17 10:25:31.128510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:30 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:31.219910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:31.250668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e3925278-2f1b-4054-b1ad-9e4c30720b53 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.236652 Oct 17 10:25:31.267935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:31 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:31.477390 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:31.478377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:31.484415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.485085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.485576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.486393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.486892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.487562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.541721 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:31.542711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:31.552225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.554507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.556580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.558760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:31.560724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:31.561391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:31.641205 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:31.651781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:31.677203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8bb8b7e6-7c52-4567-9967-479445ddfb1a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.202236 Oct 17 10:25:31.678796 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:31 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:31.786572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:31.799589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9f285141-1e55-4e62-b88d-bd4e26dc081a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.271621 Oct 17 10:25:31.816202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:31 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:32.143176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:32.144209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:32.155536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.156476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.159063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.159940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.161967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.162545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.276592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:32.277205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:32.287348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.288042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.289242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.290900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.291664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.292388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.340763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:32.352055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cc994d25-2397-4cc4-95c7-c22157ac3ae0 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.213325 Oct 17 10:25:32.353392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 61/120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:32 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:32.464530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:32.472405 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5ad85d04-d96c-40fe-b625-1b1c1e9a22bc tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.201248 Oct 17 10:25:32.473033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:32 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:32.704433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:32.705200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:32.711033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.711544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.711974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.712660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.713110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.713534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.823789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:32.824923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:32.831888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.832545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.833154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.833920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:32.834515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:32.834823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:32.863422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:32.872145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-22e34c04-35cf-4ded-8cca-a96b7c98d0ae tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.171392 Oct 17 10:25:32.872961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 62/122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:32 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:32.977990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:32.988137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-37641632-f1da-49e4-8f01-291721fdf186 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.168704 Oct 17 10:25:32.988715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:32 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:33.376578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:33.377182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:33.383769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.384263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.384702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:33.385474 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.385951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.386428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:33.497117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:33.497968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:33.505214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.505817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.506776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:33.507719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.508414 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.509282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:33.520748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:33.530607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4348c980-fedd-44b2-aab6-b33ebaa0d7e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.157735 Oct 17 10:25:33.531768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:33 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:33.645085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:33.653272 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-593dd479-fdc2-48f3-bf32-d30d0c1046fa tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.160687 Oct 17 10:25:33.653936 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 62/125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:33 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:33.895098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:33.896421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:33.902708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.903210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.903685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:33.904373 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:33.905375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:33.905834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.011595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:34.012212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:34.018180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.019174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.019625 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.020338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.020785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.021208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.051598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:34.063509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0f0b93f5-7f79-4254-bff6-c28fa2aa5cd9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.172147 Oct 17 10:25:34.065237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 64/126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:33 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:34.178096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:34.186289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9210cb93-fd31-48ef-9b76-e3f174bd3532 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.178258 Oct 17 10:25:34.186659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 63/127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:34 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:34.555365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:34.555969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:34.561773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.562254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.562716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.563397 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.563847 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.564265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.675528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:34.676957 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:34.684215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.684840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.685354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.686158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.686994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.687494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.703393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:34.706759 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:34.715889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ce37717c-877e-48d7-8f07-d6e39ff555a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.165159 Oct 17 10:25:34.724038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 65/128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:34 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:34.825594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd552f-1059-4d09-a797-ac62de74b383", "name": "network-vif-plugged", "status": "completed", "tag": "05903ad8-a4e1-4f5e-afb2-0494b0e2bc16"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:34.836038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:34.838633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:34.839574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:34.840074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:34.846115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7332efb4-e849-49f7-a553-6e2ff633ceb3 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.173667 Oct 17 10:25:34.846867 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 64/129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:34 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:34.869854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] Creating event network-vif-plugged:05903ad8-a4e1-4f5e-afb2-0494b0e2bc16 for instance e0dd552f-1059-4d09-a797-ac62de74b383 on hv-cinder-86020 Oct 17 10:25:34.875151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-61f30841-9a99-4761-89b4-0bf0217bf725 req-411e19d9-48fe-4bd8-97a2-71a2c7643a76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056232 Oct 17 10:25:34.876384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 66/130] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:35.091609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:35.092222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:35.098296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.098822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.099261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.100128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.102015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.102015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.209364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:35.210084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:35.216327 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.216802 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.217345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.218033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.218513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.218930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.230774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:35.238577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-158e8033-9717-4ca8-8fbe-a39a8d43c796 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.151133 Oct 17 10:25:35.239262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 65/131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:35 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:35.349724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:35.358549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c0a36285-387f-44c9-add8-64fb08830bb9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.153197 Oct 17 10:25:35.359121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 67/132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:35 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:35.739915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:35.740521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:35.747315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.747790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.748223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.748910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.749361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.749783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.873907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:35.874542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:35.880314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.880793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.881222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.881917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:35.882631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:35.882740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:35.883165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:35.890370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d1c3c760-e305-4962-b0e5-4f43b991d5bc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.154225 Oct 17 10:25:35.891154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 66/133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:35 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:36.020322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:36.028355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6b630d20-1a58-4c3f-9b9d-9c1358bfc96b tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.158424 Oct 17 10:25:36.028912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:35 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:36.262319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:36.262953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:36.268718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.269193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.269620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:36.270315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.270790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.271215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:36.275611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:36.381009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:36.383215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:36.388089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.388758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.389246 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:36.389984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.390475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.390904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:36.404020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:36.413243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-473e7715-cb74-48b5-80bd-a302c5dbf2b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1322 microversion: 2.1 time: 0.155933 Oct 17 10:25:36.414438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:36 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:36.520762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:36.529078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e647dbae-d6b7-4b2a-b90f-d357a3a43e3a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.151907 Oct 17 10:25:36.529646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:36 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:36.914765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:36.915365 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:36.921510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.921983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.922434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:36.923251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:36.923694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:36.924144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.051908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:37.052523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:37.058616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:37.059334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.059849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.060351 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.061071 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.061534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.061959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.066532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-81cececf-6329-4877-bca1-fd72652693a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.156319 Oct 17 10:25:37.067123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 68/137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:36 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:37.199641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:37.208453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a6b0ac02-752f-40f9-9da5-8c55c58ab494 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.160520 Oct 17 10:25:37.209357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 70/138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:37 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:37.438613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:37.439393 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:37.445389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.445871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.446399 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.447147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.447543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.447972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.551400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:37.552008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:37.558683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.559166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.559596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.560281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.560738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.561159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.580890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:37.589000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1207b716-9d2c-4ed0-b850-22c02b6c8299 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1517 microversion: 2.1 time: 0.154991 Oct 17 10:25:37.589575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:37 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:37.612198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:37.614670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:37.621133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.621619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.622057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.622850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.623313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.623739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.685532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'flavor' on Instance uuid fc2dfd38-7528-4af3-88c5-86afe10123b8 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:25:37.689672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:37.698890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8dbe2086-6726-41e3-8b30-3e6adc6bfdfe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.151197 Oct 17 10:25:37.699403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 71/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:37 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:37.801411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-443cfb56-e09a-4710-a8e2-aec8581bd891 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8/action" status: 200 len: 32 microversion: 2.1 time: 0.192971 Oct 17 10:25:37.802093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 70/141] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:25:37 2022] POST /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 10:25:37.812007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:37.812613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:37.818544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.819021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.819477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.820166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:37.820617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:37.821038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:37.960893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:37.970125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bf2f9781-237d-40cb-97da-66a17dcb097a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.161767 Oct 17 10:25:37.971184 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 72/142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:37 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:38.090871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:38.091601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:38.097763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.098275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.098746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.099437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.099884 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.100306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.235051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:38.235699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:38.240328 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:38.242007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.242804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.243269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.243986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.244438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.244863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.248788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-10a6efb8-1963-4b39-b8e8-1c9da087ff6a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.162177 Oct 17 10:25:38.249431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 71/143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:38 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:38.380286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:38.388100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f4caa001-9753-48de-84d4-e02379d8c022 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.158200 Oct 17 10:25:38.388674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 73/144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:38 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:38.724250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:38.724857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:38.730918 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=96 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:38.738274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.739777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.740460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.743115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:38.745541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:38.746483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:38.900531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:38.909736 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-057117c8-15ab-455b-aaa3-651d2ec16a39 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.192538 Oct 17 10:25:38.914826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:38 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:38.996262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:38.997261 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:39.003441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.004254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.004681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.005369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.005843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.006440 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.149053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:39.157505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-115a0c99-5d40-4c3d-bc60-55e8f7bde0eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.167903 Oct 17 10:25:39.158090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:38 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:39.273233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:39.273905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:39.281000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.282064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.282539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.283256 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.283860 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.284490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.412795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:39.414299 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:39.417623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:39.422494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.423483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.424090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.424960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.425565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.426136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.477434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:39.485648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e3c72607-809d-4754-ace5-41304e0865ac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.216304 Oct 17 10:25:39.486932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:39 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:39.619360 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:39.630178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-94a9c115-1213-44f3-a358-260deb017b9d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.221756 Oct 17 10:25:39.630832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:39 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:39.935236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:39.936266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:39.951302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.952031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.953462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:39.954482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:39.955211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:39.955962 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.122422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:40.130349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4349610f-3467-41c6-aa4c-ae279af1a786 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.201364 Oct 17 10:25:40.130939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:39 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:40.181737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:40.182478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:40.189496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.190135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.190594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.191449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.191894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.192313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.336051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:40.346746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3affa712-8f18-400d-8dcd-b255180c7153 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.169701 Oct 17 10:25:40.347551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:40 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:40.511421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:40.512033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:40.518063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.518597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.519034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.519801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.520168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.520619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.653168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:40.653776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:40.659861 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.660343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.660780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.661465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:40.661919 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:40.662368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:40.701632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:40.712223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4ad1c2cd-a9b8-49d1-b2a7-d34b4d0a72b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.205227 Oct 17 10:25:40.712825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:40 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:40.821118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:40.828962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ca8c71ef-9ea2-4ec9-b78c-a79e252fecbb tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.179616 Oct 17 10:25:40.829533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:40 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:41.153493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:41.154103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:41.160323 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.160851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.161290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.162003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.162545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.162999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.301576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:41.310277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-125c9bbe-6aef-4e0c-8254-c5209f957b84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.160747 Oct 17 10:25:41.310875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:41 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:41.370697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:41.371399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:41.377490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.378102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.378629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.379506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.379954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.380532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.516313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:41.524486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ff320491-6998-46d0-8831-a09df1dd3015 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.158019 Oct 17 10:25:41.525060 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:41 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:41.735800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:41.736460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:41.743280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.743764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.744243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.744885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.745340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.745768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.852475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:41.853559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:41.859772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.860617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.861359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.862146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:41.862765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:41.863183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:41.955755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:41.965483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-57ea62b8-8621-41ff-9c64-34d4c3338223 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.233835 Oct 17 10:25:41.966149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:41 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:42.019413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:42.027034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4ed02ac5-cfd6-470a-86ae-83d959bacfdf tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.179060 Oct 17 10:25:42.027576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:41 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:42.333036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:42.333726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:42.339764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:42.340249 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:42.340690 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:42.341381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:42.341838 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:42.342261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:42.488440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:42.497233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3f432971-0add-4aa7-a747-a870f843574c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.168204 Oct 17 10:25:42.498287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:42 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:42.549283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:42.549989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:42.556365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:42.556982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:42.557578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:42.558534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:42.559121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:42.559647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:42.706417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:42.715159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fd8c3705-e14e-481d-8a77-d736eeb88ff8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.170022 Oct 17 10:25:42.715829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:42 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:42.989633 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:42.990463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:42.997573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:42.998049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:42.998759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:42.999617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.000069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.000482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.055023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:43.055737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:43.062077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.062686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.063185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.063984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.064629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.065275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.158758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:43.181723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-60693f24-e054-4c30-94e7-a70dbc23970c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.195733 Oct 17 10:25:43.186610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:42 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:43.287814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:43.296173 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d1f8e9f8-b36c-41bf-94a7-fe585f55f36d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.246127 Oct 17 10:25:43.296752 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 81/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:43 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:43.520237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:43.520961 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:43.528402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.528985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.529415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.530133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.530632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.531077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.735523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:43.739277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:43.740058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:43.744741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-eadebd02-dc57-4341-8f75-24369e731990 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.228288 Oct 17 10:25:43.745340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:43 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:43.747239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.748007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.748726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.749596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:43.750009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:43.750582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:43.914466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:43.922513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4cf54ff0-d835-4fae-9c8c-02b182592573 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.187696 Oct 17 10:25:43.923173 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:43 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:44.209251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:44.210421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:44.217477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.218142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.218652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.219535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.220167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.220601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.319569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:44.320469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:44.330266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.330866 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.331349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.332212 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.333113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.333814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.339556 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:44.399525 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:44.403878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:44.409841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3c66b7d5-f7e0-4a8a-953a-0a5ba10eb528 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.204561 Oct 17 10:25:44.410630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:44 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:44.480139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:44.487868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f53986f9-2d5d-44c8-ba74-6b9f923c461d tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.172238 Oct 17 10:25:44.488368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:44 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:44.768845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:44.769450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:44.778168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.778718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.779356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.780046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.780477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.780893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.915940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:44.923696 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-849a8b93-973f-464f-a7cf-61b548c32c92 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.158749 Oct 17 10:25:44.924277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:44 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:44.947282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:44.947918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:44.953984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.954498 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.954930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:44.955610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:44.956059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:44.956479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.083158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:45.091026 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c37a253c-9f4f-443a-9cb1-f69d517caba5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.148317 Oct 17 10:25:45.091612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:44 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:45.434678 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:45.435284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:45.441252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.441731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.442166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.442876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.443330 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.443753 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.512900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:45.513513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:45.520051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.520535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.520966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.521662 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.522111 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.522578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.586227 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:45.594648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-89eaa16f-8c13-4be1-aa3c-d0fc5a6437c2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.163651 Oct 17 10:25:45.595401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:45 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:45.655000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:45.663177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b048df0f-34a0-4d09-aa81-93ff2d025c54 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1314 microversion: 2.1 time: 0.155056 Oct 17 10:25:45.663860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:45 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:45.947447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:45.947971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:45.953886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.954391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.954825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:45.955509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:45.955960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:45.956382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.099365 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:46.107722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9232aed4-35c9-4333-84ae-37f19eef9a4c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.165088 Oct 17 10:25:46.108299 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:45 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:46.116157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:46.117339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:46.123885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.124377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.124842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.125535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.126221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.126737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.292669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:46.300815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4b783961-5446-4695-86e9-c4bcc8d3198f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.188494 Oct 17 10:25:46.301388 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:46 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:46.617780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:46.618419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:46.624948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.625436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.625872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.626623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.627083 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.627503 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.686639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:46.687324 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:46.704009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.704809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.705209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.705913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.706390 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.706982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.941890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:46.944752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:46.951114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-25f96969-d7e6-42e7-b597-70ffe28ba1db tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1501 microversion: 2.1 time: 0.268542 Oct 17 10:25:46.954663 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:46 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:46.957225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1de6410d-303b-45f2-ba39-09c0590ea70f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.342204 Oct 17 10:25:46.959538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 85/172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:46 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:46.962503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1f19cb-20df-4e33-810d-5e2ced70ef28", "name": "network-vif-plugged", "status": "completed", "tag": "1195ec6d-7c1a-4c0b-92b5-beb07772c367"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:46.973613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:46.974396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:46.975006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:46.990294 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] Creating event network-vif-plugged:1195ec6d-7c1a-4c0b-92b5-beb07772c367 for instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 on hv-cinder-86020 Oct 17 10:25:46.999614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-944d4513-d000-4b7d-9de3-28ae9cf56cc7 req-9649e48c-fe5f-420e-8114-9f24919ec990 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043353 Oct 17 10:25:47.000428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 88/173] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:47.131063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:47.132197 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:47.139506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.139994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.140427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:47.141198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.141574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.141998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:47.327079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:47.328069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:47.339032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.339826 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.340924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:47.341107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:47.342105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.342810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.343540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:47.353558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3390d913-9146-43e1-bcf4-d6fd4f6584e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.221695 Oct 17 10:25:47.354519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 86/174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:47 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:47.539049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:47.549957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cf8a7879-5d64-4ece-9b96-c3a01bd9080b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.226947 Oct 17 10:25:47.551326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 89/175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:47 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:47.983423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:47.984105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:47.990346 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.991064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.991856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:47.992569 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:47.993046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:47.993474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:48.148374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:48.156469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bc22efec-674f-418b-8e10-92736e8887b5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.177154 Oct 17 10:25:48.157062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 87/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:47 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:48.378163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:48.378996 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:48.385642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:48.386414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:48.387013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:48.387794 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:48.388566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:48.388993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:48.538643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:48.548070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-226ac0cb-2b3b-4cfe-9268-f8187b1d9a0f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.173692 Oct 17 10:25:48.548846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 90/177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:48 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:48.575937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:48.576637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:48.582621 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:48.583173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:48.583676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:48.584436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:48.585668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:48.586181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:48.723922 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:48.732149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-637d0cb5-f1ee-41e0-a5aa-22bbee4bc94b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.160306 Oct 17 10:25:48.732722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:48 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:49.183689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:49.184426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:49.199499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.204589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.205242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.207334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.209836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.210658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.382477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:49.390586 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-208a3b9c-e742-48e3-b43d-b094ab5694a9 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.214730 Oct 17 10:25:49.391158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 91/179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:49 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:49.526832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49bc2766-6c6e-4de5-ae99-42e030452c8c"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:49.529292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:49.535220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.535680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.536107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.536790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.537233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.537651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.571055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:49.571854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:49.577979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.578499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.578981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.579696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.580055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.580451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.723857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:49.733768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-86a0c69c-44c6-46e4-af48-dfbfa9084c3f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.167794 Oct 17 10:25:49.734667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:49 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:49.754989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:49.755602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:49.762008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.762549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.763007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.763697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:49.764149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:49.764569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:49.908842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:49.918200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c09ab22e-0fc9-4923-9184-507c235e8136 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.166954 Oct 17 10:25:49.918813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 93/181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:49 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:50.414928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:50.415730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:50.422476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.424843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.424843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:50.425747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.426640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.427369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:50.564313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:50.572663 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d6c97a34-8ab3-41dd-81cd-9b5733fd9abf tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.162226 Oct 17 10:25:50.573241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 94/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:50 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:50.756842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:50.757573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:50.764322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.764876 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.765375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:50.766124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.766670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.767153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:50.911495 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:50.921258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1fbc19cb-7475-4306-9781-577c6f175944 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.167922 Oct 17 10:25:50.922222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 95/183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:50 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:50.940709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:50.941308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:50.947985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.948463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.948892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:50.949720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:50.950170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:50.950613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:51.090129 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:51.097957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-20ebb412-9642-48bd-a139-55034bacacaa tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.160963 Oct 17 10:25:51.098649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:50 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:51.596981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:51.597621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:51.603721 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:51.604443 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:51.604879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:51.605638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:51.606099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:51.606543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:51.748454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:51.758671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cb495eb2-63c2-44c1-8d68-7e7b4b6a37d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.165739 Oct 17 10:25:51.759724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 97/185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:51 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:51.943950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:51.945129 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:51.951001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:51.951475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:51.951900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:51.952578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:51.953021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:51.953436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:52.097178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:52.107666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-32a9f730-e6a5-4102-bc3f-ae95d1080ffa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.167517 Oct 17 10:25:52.108252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 98/186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:51 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:52.120647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:52.121267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:52.127290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:52.127766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:52.128195 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:52.128875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:52.129322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:52.129788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:52.258789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:52.266293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9a25eb7f-7826-4473-a678-9e2e1e2eead0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.149208 Oct 17 10:25:52.266887 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 99/187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:52 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:52.782632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:52.783276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:52.789608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:52.790085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:52.790552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:52.791242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:52.791692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:52.792357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:52.808685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:25:52.927326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:52.935032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1523009a-a20e-4bcd-9d98-7c26ef2d6af8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.156309 Oct 17 10:25:52.935592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 100/188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:52 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:53.131199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:53.131800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:53.138683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.139164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.139592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:53.140267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.140710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.141125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:53.267741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:53.275534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-73bedd8a-e905-4a5d-b51f-dd6af9e16a88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.148072 Oct 17 10:25:53.276094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 101/189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:53 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:53.288323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:53.288912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:53.294944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.295412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.295863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:53.296561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.297007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.297422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:53.423769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:53.432100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-007be22e-6597-4ff8-8972-84492210a6ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.147171 Oct 17 10:25:53.432671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 102/190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:53 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:53.956937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:53.957550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:53.963991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.964467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.964896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:53.965577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:53.966024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:53.966470 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:54.095388 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:54.103697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1f10e856-32db-416f-80cc-6a7de83bf19f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.150552 Oct 17 10:25:54.104257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 103/191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:53 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:54.297484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:54.298088 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:54.303894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:54.304377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:54.305224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:54.306102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:54.306570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:54.306996 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:54.434534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:54.442115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-73365085-8f7b-4eec-a49e-1a33d89149ae tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.148532 Oct 17 10:25:54.442713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 104/192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:54 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:54.457351 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:54.458041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:54.464549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:54.465021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:54.465448 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:54.466130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:54.466609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:54.467027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:54.633864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:54.642015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-815a6452-f520-47ce-96d7-ec7a0dbf68df tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.189471 Oct 17 10:25:54.642799 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 105/193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:54 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:55.126152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:55.127022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:55.134928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.135405 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.135835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.136519 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.137130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.137546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.265917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:55.274296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-def391e0-fa7e-4e09-8557-60cc19d703e2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1367 microversion: 2.1 time: 0.151674 Oct 17 10:25:55.274998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 106/194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:55 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:55.467217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:55.467850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:55.473933 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.474446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.474886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.475645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.476236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.476742 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.671432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:55.683213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2c2d2235-95b2-4d04-a9ac-fda49997c310 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1363 microversion: 2.1 time: 0.218615 Oct 17 10:25:55.683931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 107/195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:55 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:55.689673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:55.690456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:55.697769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.698633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.699225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.700210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:55.700803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:55.702007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:55.766209 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a8cf4e53-5f92-4691-a0fc-393f869a8efe tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "POST /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.244099 Oct 17 10:25:55.766884 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 89/196] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:25:49 2022] POST /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824/os-volume_attachments => generated 194 bytes in 6246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:25:55.866584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:55.875030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6e09ce34-5c1f-4f6c-9bdd-786b22bad907 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.189917 Oct 17 10:25:55.875598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 108/197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:55 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:56.298347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:56.299061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:56.305562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.306060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.306531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.307354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.307859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.308362 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.519216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:56.528158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2aa98a54-96d2-4517-9f36-5040b47c3e4e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1557 microversion: 2.1 time: 0.234644 Oct 17 10:25:56.528756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 90/198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:56 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1557 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:56.550928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:56.551426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:56.557237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.557716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.558182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.558898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.559386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.559810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.678953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-38c8522a-db9d-434d-a668-d972b96fb82f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131894 Oct 17 10:25:56.679539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 109/199] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:25:56 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:56.708400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:56.709106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:56.715609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.716124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.716607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.717351 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.717860 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.718306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.881519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:56.894418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f92ce725-49a6-4ffa-8592-0a88c6fa7594 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1549 microversion: 2.1 time: 0.189435 Oct 17 10:25:56.898029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:56.898166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 91/200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:56 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:25:56.900084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:56.916203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.916203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.916203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.916203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.916504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.916504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.917845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:56.918360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:56.924670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.925598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.926384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:56.927363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:56.927959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:56.928717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:57.019874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ba6d47e8-a6aa-4982-9aea-306eaf984383 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106197 Oct 17 10:25:57.028876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 92/201] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:25:56 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:57.713512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:57.721522 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ce09a60b-e804-4845-87e8-26613457e5e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.827812 Oct 17 10:25:57.722277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 110/202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:56 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:58.417365 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0dd552f-1059-4d09-a797-ac62de74b383", "tag": "05903ad8-a4e1-4f5e-afb2-0494b0e2bc16"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:58.432129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:58.432979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:58.433616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:58.445776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] Creating event network-changed:05903ad8-a4e1-4f5e-afb2-0494b0e2bc16 for instance e0dd552f-1059-4d09-a797-ac62de74b383 on hv-cinder-86020 Oct 17 10:25:58.451830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-115f0d0e-4f91-4197-9148-b0c6101b4c47 req-9134df38-1093-42b6-9736-8471c0467454 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039351 Oct 17 10:25:58.453017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 93/203] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:58.690931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1f19cb-20df-4e33-810d-5e2ced70ef28", "tag": "1195ec6d-7c1a-4c0b-92b5-beb07772c367"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:25:58.711503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:58.712098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:58.712546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:58.724771 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] Creating event network-changed:1195ec6d-7c1a-4c0b-92b5-beb07772c367 for instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 on hv-cinder-86020 Oct 17 10:25:58.735533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-0a5d997f-97d2-49fe-a990-8b1c05926dbd req-a93b6949-0b39-49b5-b2b7-445091009d1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050277 Oct 17 10:25:58.741016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 111/204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:25:58.746006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:58.746991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:25:58.754255 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:58.754999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:58.755826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:58.757063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:25:58.757699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:25:58.759067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:25:58.960000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:25:58.968375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-735a6685-a85a-487f-99a9-d836b0318c81 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.226922 Oct 17 10:25:58.968971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 94/205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:58 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:25:59.993427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:25:59.994139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:00.001277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:00.001766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:00.002193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:00.002914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:00.003381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:00.003802 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:00.176964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:00.185270 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7defd206-b596-4602-a470-9ba00e9eddd6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.196621 Oct 17 10:26:00.186534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 112/206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:25:59 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:01.212775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:01.213397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:01.220802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:01.221568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:01.222108 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:01.223311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:01.224105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:01.225291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:01.700965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:01.712155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fd231a37-5db3-4f13-bbf2-e2076bf5bba6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.506352 Oct 17 10:26:01.713286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 95/207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:01 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:02.736594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:02.737211 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:02.745911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:02.746669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:02.747268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:02.748167 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:02.748621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:02.749204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:02.931685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:02.940473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5da3259a-1cb9-4699-bacd-e131a44bc2a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.207595 Oct 17 10:26:02.942459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 113/208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:02 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:03.964909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:03.965730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:03.972237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:03.972716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:03.973146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:03.974062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:03.974554 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:03.974981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:04.136876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:04.144719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dbcabe28-e312-4d80-9397-35142b8d011a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.183793 Oct 17 10:26:04.145307 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 96/209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:03 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:05.172806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:05.173976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:05.181012 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:05.181822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:05.182588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:05.183391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:05.183923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:05.184436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:05.332348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:05.341231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ec4e3956-02c7-47a2-b473-9d1c6b7b49ff tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.176902 Oct 17 10:26:05.342058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 114/210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:05 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:06.366452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:06.367875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:06.375270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:06.375918 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:06.376463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:06.377304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:06.378099 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:06.378691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:06.661671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:06.673478 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-99fcb05d-29c7-4e43-a137-266e7250ed31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.312125 Oct 17 10:26:06.687111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 97/211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:06 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:07.698044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:07.698834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:07.705863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:07.707001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:07.708486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:07.710057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:07.710775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:07.712194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:07.950009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:07.963383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-64b6e56d-b5dc-46e9-ad97-c8fc028be011 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.269953 Oct 17 10:26:07.963979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 115/212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:07 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:08.987389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:08.988113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:08.990903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=52 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:08.996706 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:08.997528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:08.998221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:08.999222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:09.000020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:09.000789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:09.006777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:09.217333 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:09.234164 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-84d5013c-8f9e-4ecb-a8e6-d31fe0b254f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.250451 Oct 17 10:26:09.252946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 98/213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:08 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:10.280200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:10.282635 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:10.290047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=81 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:10.297045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:10.297828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:10.298993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:10.301965 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:10.302745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:10.303428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:10.691899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:10.710363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-16ad12d9-2c56-460f-ac5a-08c29cd3668f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.452860 Oct 17 10:26:10.713906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 116/214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:10 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:11.672638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0743001e-f7c5-41e5-aa1d-96ebcba1d731 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Action: 'create', calling method: .version_select at 0x7fe9ba910940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-785350402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6drOomj1dp1M8lkZiG+3JxcZy2sCkmSfn8R+KYgC/qbA9NIaAxAzDxTwpvQZsOJQunhuiTkbe2zSlO/J2RSyb+ljg+JVnfd80owvAjmq91H0bEKSUfF1p8VmH3n1BgOQ=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:11.692770 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-0743001e-f7c5-41e5-aa1d-96ebcba1d731 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for project 0e87741d68c74ae29ecea930893e3449. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:26:11.697263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-0743001e-f7c5-41e5-aa1d-96ebcba1d731 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for user a5b7190649694b9882ab34c0f3114a3e and project 0e87741d68c74ae29ecea930893e3449. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:26:11.737211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0743001e-f7c5-41e5-aa1d-96ebcba1d731 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.242171 Oct 17 10:26:11.739126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:11.740896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:11.743710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 99/215] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:26:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:26:11.761719 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:11.762427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:11.763651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:11.765596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:11.766275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:11.767896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:12.029352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:12.041540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c0ddaec5-d5b2-46d4-becf-71a7d2e38717 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.308471 Oct 17 10:26:12.054966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 117/216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:11 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:13.067425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:13.068025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:13.075553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:13.076350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:13.077008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:13.077920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:13.078612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:13.079257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:13.285157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:13.295280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-df06fef0-38f2-4e45-9c58-0ea7128145dd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.232029 Oct 17 10:26:13.296740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 100/217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:13 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:14.318490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:14.328333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:14.338207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:14.339116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:14.339554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:14.340258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:14.340705 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:14.341120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:14.355042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:14.489606 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:14.498362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-65a89de3-7788-4713-8e4a-b9067518c3ec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.183734 Oct 17 10:26:14.498934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 118/218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:14 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:15.521839 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:15.522768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:15.530732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:15.531475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:15.531906 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:15.533278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:15.533886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:15.534496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:15.721397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:15.734749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d1280a4d-2e1a-4f54-a675-3d36fcd47dd5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.217200 Oct 17 10:26:15.738666 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 101/219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:15 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:16.757010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:16.758114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:16.764079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:16.764520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:16.764948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:16.765630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:16.766074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:16.766540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:16.917438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:16.925995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c9305283-860d-46f8-99bf-f4e9af709fc8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.172776 Oct 17 10:26:16.936127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 119/220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:16 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:17.951484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:17.952757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:17.962836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:17.963422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:17.963928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:17.964771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:17.965380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:17.966028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:18.123712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:18.131422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bcc02697-c884-4a4a-a15f-53d4d6a274bd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.184473 Oct 17 10:26:18.131991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 102/221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:17 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:19.154476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:19.155080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:19.160960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:19.161443 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:19.161874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:19.162588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:19.163041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:19.163465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:19.296529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:19.305199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2b818800-f0f3-4e6b-bf2d-a3bf14d17612 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.154387 Oct 17 10:26:19.305775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 120/222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:19 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:20.328228 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:20.328998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:20.335174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:20.336249 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:20.336615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:20.337418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:20.337905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:20.338348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:20.466258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:20.473817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7f19d1d5-2c39-49f2-b74a-a549da096bb8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.149577 Oct 17 10:26:20.474407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 103/223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:20 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:21.497660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:21.498260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:21.504247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:21.504720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:21.505146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:21.505820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:21.506266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:21.506704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:21.633419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:21.641050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-71e297f8-6344-4336-98cb-038107ff3e1f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.147190 Oct 17 10:26:21.641624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 121/224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:21 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:22.664609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:22.665184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:22.667506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:22.673420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:22.673894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:22.674339 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:22.675033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:22.675484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:22.675901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:22.810147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:22.817987 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-048973f7-171f-42b2-a357-069e49a7b8a1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.157891 Oct 17 10:26:22.818580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 104/225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:22 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:23.841948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:23.842642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:23.849126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:23.849630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:23.850060 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:23.850827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:23.852007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:23.852534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:24.011301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:24.029178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d037cf68-6a5d-4069-a907-c6dd96d4946a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.190986 Oct 17 10:26:24.030210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 122/226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:23 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:25.053762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:25.055133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:25.061877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:25.062605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:25.063050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:25.063756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:25.064454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:25.064906 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:25.222198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:25.230610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-11324e11-b95e-4399-b062-afa56f2a2d3b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.181324 Oct 17 10:26:25.231190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 105/227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:25 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:26.254858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:26.255708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:26.266231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:26.266830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:26.273298 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.274417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.274543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.274911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.275484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.275659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.276191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.276467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.276894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.277003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.277353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.277927 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.450827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:26.458980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2cf7fa08-c239-429d-b54a-f2920b451c8e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.208875 Oct 17 10:26:26.459548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:26:26.475041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 123/228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:26 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:26.555768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-25668d7e-6a10-4510-8e00-3870c9eb0ef1 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 204 len: 0 microversion: 2.1 time: 0.292896 Oct 17 10:26:26.556786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 106/229] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:26:26 2022] DELETE /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:26:26.564846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:26.565506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:26.572220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.572705 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.573139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.573832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:26.574290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:26.574745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:26.717767 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:26.730141 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-923507eb-d241-4848-8d72-911a961d9117 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1553 microversion: 2.1 time: 0.167835 Oct 17 10:26:26.731559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 124/230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:26 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:27.484462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:27.485189 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:27.492560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:27.493111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:27.493548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:27.494268 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:27.494748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:27.495338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:27.642041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:27.650730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b4f1d101-93f9-428a-b4db-fc911a6937e8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.170402 Oct 17 10:26:27.651309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 107/231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:27 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:27.754917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:27.758024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:27.764802 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:27.765362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:27.765870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:27.766692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:27.767219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:27.767712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:27.908307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:27.918926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-38cafc0e-9bb0-4d5e-b1d0-414ee5bea335 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1553 microversion: 2.1 time: 0.167830 Oct 17 10:26:27.919508 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 125/232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:27 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:28.674580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:28.675233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:28.682276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:28.682802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:28.683239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:28.683974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:28.684433 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:28.685084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:28.826211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:28.834154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-992cf37c-2197-4af4-a5c1-e46d95ef48da tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.163657 Oct 17 10:26:28.834830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 108/233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:28 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:28.942894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:28.943542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:28.949513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:28.949988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:28.950445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:28.951170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:28.951699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:28.952160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:29.092912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:29.102162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-238b5218-46b6-4118-beb3-760074d7cb3e tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1553 microversion: 2.1 time: 0.163091 Oct 17 10:26:29.103276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 126/234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:28 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:29.858534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:29.859863 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:29.867522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:29.868013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:29.868445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:29.869144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:29.869599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:29.870024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:30.027415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:30.037141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6f4fd813-a9ed-4fb0-b652-61198ee3ee8c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.183064 Oct 17 10:26:30.037883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 109/235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:29 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:30.126814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:30.127413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:30.133465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:30.133941 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:30.134404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:30.135091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:30.135537 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:30.135950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:30.290283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:30.299734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-19e6725b-7e4a-4840-9155-39954aa5f400 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1553 microversion: 2.1 time: 0.176533 Oct 17 10:26:30.300626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 127/236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:30 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:31.066583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:31.067979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:31.075804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:31.076387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:31.076896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:31.077818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:31.078369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:31.078869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:31.326053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:31.327969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:31.340723 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:31.341220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:31.341653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:31.343073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:31.344137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:31.346951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:31.347591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:31.359994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bd60af24-016a-4de8-8ffe-79fb12c6098d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.301766 Oct 17 10:26:31.361142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 110/237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:31 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:31.366172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daff838-b032-48a4-bcaa-413c56fc7824", "name": "network-vif-deleted", "tag": "35980f72-8911-433f-8989-708b4cfffccb"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:31.388976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:31.389463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:31.389897 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:31.404640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] Creating event network-vif-deleted:35980f72-8911-433f-8989-708b4cfffccb for instance 9daff838-b032-48a4-bcaa-413c56fc7824 on hv-cinder-86020 Oct 17 10:26:31.411553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-b22ab3e4-a740-4ff2-8e3d-1da09537bad8 req-746cce29-be9e-41fe-bbe0-3d375e5332ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048614 Oct 17 10:26:31.412672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 111/238] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:26:31.471375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:31.488449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-851886f1-c76e-4cf7-a10b-c2b9918dc423 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1511 microversion: 2.1 time: 0.168004 Oct 17 10:26:31.489806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 128/239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:31 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:32.386193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:32.387148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:32.395591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:32.396175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:32.396850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:32.398425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:32.399008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:32.399536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:32.512787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:32.514748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:32.522611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:32.523993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:32.524585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:32.525733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:32.526186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:32.526822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:32.548405 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:32.557718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0146fc63-9f0e-4e7e-8e91-298cdac68a87 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.177843 Oct 17 10:26:32.558743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 112/240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:32 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:32.607148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:32.614411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-24cd53bb-82a8-45a5-aab4-8f9ad0eb1fa7 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1511 microversion: 2.1 time: 0.105171 Oct 17 10:26:32.614810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 129/241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:32 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:33.585755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:33.587247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:33.595973 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:33.596538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:33.597074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:33.598033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:33.598602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:33.599250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:33.645347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:33.646033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:33.661018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:33.663371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:33.664360 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:33.666166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:33.666670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:33.667386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:33.712230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:33.712768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:33.713310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:33.713837 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lazy-loading 'fault' on Instance uuid 9daff838-b032-48a4-bcaa-413c56fc7824 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:26:33.783867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:33.793887 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8d8a581c-49ca-4260-a3e5-62defb8ed163 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1350 microversion: 2.1 time: 0.155775 Oct 17 10:26:33.794540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 130/242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:33 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:33.842777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:33.854206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e985864a-9eb7-4cd6-8e3d-24b6b094d6cb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1523 microversion: 2.1 time: 0.274346 Oct 17 10:26:33.854821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 113/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:33 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:34.834578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:34.836486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:34.843793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:34.844600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:34.845398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:34.846696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:34.847607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:34.848255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:34.879229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:34.881039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:34.895194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:34.895979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:34.896689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:34.897784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:34.899059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:34.899866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:34.906441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:34.907487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:34.908757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:34.909225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lazy-loading 'fault' on Instance uuid 9daff838-b032-48a4-bcaa-413c56fc7824 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:26:35.017429 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca96437c5fdc4c1ba41ca7960813dfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2cba05193f429fb9ffef6f66205945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:35.030895 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f4600a2f-00ed-44b3-b7c1-b718467c480f tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 200 len: 1350 microversion: 2.1 time: 0.202343 Oct 17 10:26:35.035169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 131/244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:34 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 1350 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:35.229837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:35.234371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:35.245652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-52d195cc-601f-4415-85b3-c4ac217a0116 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1503 microversion: 2.1 time: 0.370913 Oct 17 10:26:35.247628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 114/245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:34 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:35.279345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:35.282117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:35.294625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:35.297985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:35.298746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:35.301135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:35.301699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:35.303725 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:35.496665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:35.505355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-222231a6-11df-499b-95bf-a6faafb24f89 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1515 microversion: 2.1 time: 0.237987 Oct 17 10:26:35.515332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 132/246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:35 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:36.061043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:36.061658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:36.091127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:36.091711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:36.092180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:36.092932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:36.104698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:36.107661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:36.143340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] HTTP exception thrown: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Request method failure captured: Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 HTTP/1.1 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1yMG0pXuH3lBD4Gmp_rZU5wwqQ9dDeyaNZZ221IgAK95mJXCLKb8YSQICB0Us-89QKxXtN7n5USgrQ7_vhyDAAk2f_O7Xjvr5I4ikwYYjQnedGYUhjr32TgBFV3L6QAWBzyTJDR5ZmnWrhHMN31xoVzsmOZU4vugyQqkMzDLqyvgc Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:26:36.149724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: ca96437c5fdc4c1ba41ca7960813dfae Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.151110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '9daff838-b032-48a4-bcaa-413c56fc7824'} Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:36.151862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.153025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.154102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Returning 404 to user: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:36.154102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c3331019-301b-4821-8d13-85f7e6a13e31 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 404 len: 111 microversion: 2.1 time: 0.094259 Oct 17 10:26:36.154102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 115/247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:36 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:26:36.308469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:36.311568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:36.330513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:36.331237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:36.331883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:36.332745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:36.333482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:36.334052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:36.350958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] HTTP exception thrown: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Request method failure captured: Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824/os-volume_attachments HTTP/1.1 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1yMG0pXuH3lBD4Gmp_rZU5wwqQ9dDeyaNZZ221IgAK95mJXCLKb8YSQICB0Us-89QKxXtN7n5USgrQ7_vhyDAAk2f_O7Xjvr5I4ikwYYjQnedGYUhjr32TgBFV3L6QAWBzyTJDR5ZmnWrhHMN31xoVzsmOZU4vugyQqkMzDLqyvgc Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:36.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: ca96437c5fdc4c1ba41ca7960813dfae Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.359163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'server_id': '9daff838-b032-48a4-bcaa-413c56fc7824'} Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:36.359857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:36.361146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:36.362544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Returning 404 to user: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:36.362544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ea0a5ec7-0416-4363-ac1b-37cc1eaa6add tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056732 Oct 17 10:26:36.362544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 133/248] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:26:36 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:26:38.217407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:38.219713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:38.228859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.229531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.230436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.231540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.232171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.232752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.260828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'flavor' on Instance uuid b0a35982-9d23-4588-965f-96ea10757f72 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:26:38.353506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f90dd55a-e2f9-4140-b8b4-c2c0fda03bc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/action" status: 200 len: 32 microversion: 2.1 time: 0.140325 Oct 17 10:26:38.355170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 116/249] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:26:38 2022] POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:26:38.364130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:38.365809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:38.387184 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.388063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.388758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.389787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.391232 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.391894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.623439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:38.625812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:38.638263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b2de2455-35f5-40ab-9509-d1d4ce8cd4b5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.278060 Oct 17 10:26:38.638972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 134/250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:38 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:38.685367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:38.686156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:38.692759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.693252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.693692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.694573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.695275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.695709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.712288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] HTTP exception thrown: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Request method failure captured: Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 HTTP/1.1 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1yMG0pXuH3lBD4Gmp_rZU5wwqQ9dDeyaNZZ221IgAK95mJXCLKb8YSQICB0Us-89QKxXtN7n5USgrQ7_vhyDAAk2f_O7Xjvr5I4ikwYYjQnedGYUhjr32TgBFV3L6QAWBzyTJDR5ZmnWrhHMN31xoVzsmOZU4vugyQqkMzDLqyvgc Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:26:38.714003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: ca96437c5fdc4c1ba41ca7960813dfae Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.715725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '9daff838-b032-48a4-bcaa-413c56fc7824'} Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:38.716538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.717831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.724503 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Returning 404 to user: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:38.725390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-793f18cc-550d-42d5-8666-038cde02bb17 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 404 len: 111 microversion: 2.1 time: 0.044516 Oct 17 10:26:38.726913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 117/251] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:26:38 2022] DELETE /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:26:38.735768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:38.736534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] [instance: 9daff838-b032-48a4-bcaa-413c56fc7824] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:38.743781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.744418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.744972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.745805 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:38.746446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:38.746931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:38.761986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] HTTP exception thrown: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Request method failure captured: Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 HTTP/1.1 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1yMG0pXuH3lBD4Gmp_rZU5wwqQ9dDeyaNZZ221IgAK95mJXCLKb8YSQICB0Us-89QKxXtN7n5USgrQ7_vhyDAAk2f_O7Xjvr5I4ikwYYjQnedGYUhjr32TgBFV3L6QAWBzyTJDR5ZmnWrhHMN31xoVzsmOZU4vugyQqkMzDLqyvgc Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:38.764591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e2cba05193f429fb9ffef6f66205945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 6e2cba05193f429fb9ffef6f66205945 Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-DeleteServersTestJSON-1620799955 Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: ca96437c5fdc4c1ba41ca7960813dfae Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-DeleteServersTestJSON-1620799955-project Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.766079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '9daff838-b032-48a4-bcaa-413c56fc7824'} Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:38.770489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. Oct 17 10:26:38.771629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:38.772842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] Returning 404 to user: Instance 9daff838-b032-48a4-bcaa-413c56fc7824 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:38.772842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2bba2532-fc84-4c89-8a48-fa4df45862f4 tempest-DeleteServersTestJSON-1620799955 tempest-DeleteServersTestJSON-1620799955-project] 10.222.0.16 "GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824" status: 404 len: 111 microversion: 2.1 time: 0.034857 Oct 17 10:26:38.772842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 135/252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:38 2022] GET /compute/v2.1/servers/9daff838-b032-48a4-bcaa-413c56fc7824 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:26:39.661213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:39.663291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:39.666121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:39.676768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:39.680143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:39.681828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:39.683170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:39.683763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:39.684469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:39.996751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:40.017926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3e389202-1ad1-4822-b913-aa952d808fdd tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.360489 Oct 17 10:26:40.020530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 118/253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:39 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:41.045400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:41.047864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:41.057152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=44 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:41.060393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:41.061423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:41.062394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:41.063527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:41.064420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:41.065244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:41.494008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:41.510083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-866de3ae-f9aa-4f97-97ca-116d57284a2f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.469554 Oct 17 10:26:41.511098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 136/254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:41 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:42.553665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:42.555271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:42.563568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:42.564348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:42.565111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:42.565983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:42.566859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:42.567464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:42.892078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:42.903269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ba85d1bf-3314-4ac7-be36-fa32faa3e275 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.360142 Oct 17 10:26:42.905419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 119/255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:42 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:43.933955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:43.934893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:43.959336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1559544523", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785350402", "security_groups": [{"name": "tempest-secgroup-smoke-1119150375"}], "block_device_mapping_v2": [{"uuid": "4b2f6e2c-8a97-40ea-9317-a4d2bba62757", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6600083-efa1-4cdc-8469-423af4747abb"}]}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:43.962900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:43.963405 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:43.963849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:43.964567 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:43.965033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:43.965455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:44.288953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] validate_networks() for [('e6600083-efa1-4cdc-8469-423af4747abb', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:26:44.356082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:44.368014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2ef9bdc0-0f97-48b3-aa4e-aeb0ec28a7eb tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.440004 Oct 17 10:26:44.372687 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 137/256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:43 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:45.399951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:45.401346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:45.408544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:45.409291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:45.409900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:45.410841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:45.411472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:45.412735 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:45.873291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:26:45.873799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:26:45.874241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:26:45.874650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:26:45.875088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:26:45.898627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:45.899508 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:45.901762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:45.903878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:45.904785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:45.905408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:45.939380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:26:45.949705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for user a5b7190649694b9882ab34c0f3114a3e and project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:26:46.055656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:26:46.057787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2f6e2c-8a97-40ea-9317-a4d2bba62757',volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:26:46.108779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:46.137370 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5ebe1dec-b0cb-402d-8016-6412acc6d04f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.743019 Oct 17 10:26:46.139642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 138/257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:45 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:46.459580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-01ef26f9-5a3f-4bd7-82e6-a0e94512f870 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.504823 Oct 17 10:26:46.463207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 120/258] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:26:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:26:46.472918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2d294c6e-b0b5-4879-ae95-b49dd5d6fdf4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:46.473593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2d294c6e-b0b5-4879-ae95-b49dd5d6fdf4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:46.821499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2d294c6e-b0b5-4879-ae95-b49dd5d6fdf4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:46.834556 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2d294c6e-b0b5-4879-ae95-b49dd5d6fdf4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1094 microversion: 2.1 time: 0.365747 Oct 17 10:26:46.838968 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 139/259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:46 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1094 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:47.169277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:47.170069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:47.183935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:47.184577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:47.193397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:47.194277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:47.198080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:47.198583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:47.525025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:47.533141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d5f83a09-63ba-440b-ab84-6e9951d331fc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.374296 Oct 17 10:26:47.536118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 121/260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:47 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:47.862610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:47.863228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:47.877532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:47.878062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:47.882783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:47.883807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:47.884600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:47.885415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:48.027889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:48.040153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-312e87c9-3d87-42de-b432-db420871d97b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1144 microversion: 2.1 time: 0.181419 Oct 17 10:26:48.043052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 140/261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:47 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1144 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:48.137137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-61e3bb15-2d57-475c-8963-c319b1b3b405 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Action: 'create', calling method: .version_select at 0x7fe9ba910b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1512577956", "metadata": {"Type": "work"}}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-61e3bb15-2d57-475c-8963-c319b1b3b405 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 122 Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:26:48.152744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1512577956", "metadata": {"Type": "work"}}} Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:26:48.154207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1512577956', 'metadata': {'Type': 'work'}}}} Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise error Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.155133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 10:26:48.156937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 10:26:48.158714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 10:26:48.158714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.161225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-61e3bb15-2d57-475c-8963-c319b1b3b405 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.162287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-61e3bb15-2d57-475c-8963-c319b1b3b405 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.272707 Oct 17 10:26:48.164639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 122/262] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 10:26:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:26:48.177133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-16926203-dd84-4849-8124-0a4d1f98864d tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Action: 'create', calling method: .version_select at 0x7fe9bab59310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1968039702", "metadata": {"Type": "work"}}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-16926203-dd84-4849-8124-0a4d1f98864d tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 120 Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:48.185981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1968039702", "metadata": {"Type": "work"}}} Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: Oct 17 10:26:48.187441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1968039702', 'metadata': {'Type': 'work'}}}} Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise error Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi '0' Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.188197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 10:26:48.191561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 10:26:48.195780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 10:26:48.195780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.198681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-16926203-dd84-4849-8124-0a4d1f98864d tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.200539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-16926203-dd84-4849-8124-0a4d1f98864d tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027900 Oct 17 10:26:48.201898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 141/263] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 10:26:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:26:48.215534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-73fd4a08-4d35-40fa-9b4f-b00398ba9a1f tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Action: 'create', calling method: .version_select at 0x7fe9ba7fd280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-526195282", "metadata": {"Type": "work"}}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-73fd4a08-4d35-40fa-9b4f-b00398ba9a1f tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 118 Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:26:48.220777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-526195282", "metadata": {"Type": "work"}}} Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:26:48.222025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-526195282', 'metadata': {'Type': 'work'}}}} Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise error Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi '' Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.222802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 10:26:48.223952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 10:26:48.225032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 10:26:48.225032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.225032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-73fd4a08-4d35-40fa-9b4f-b00398ba9a1f tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.225032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-73fd4a08-4d35-40fa-9b4f-b00398ba9a1f tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013194 Oct 17 10:26:48.225032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 123/264] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 17 10:26:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:26:48.235337 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e96aade4-0281-453a-a4cd-1506f9e87992 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Calling method '.version_select at 0x7fe9ba8b74c0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:48.271788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-e96aade4-0281-453a-a4cd-1506f9e87992 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] HTTP exception thrown: Volume tempest-invalid-729938102 could not be found. Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e96aade4-0281-453a-a4cd-1506f9e87992 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-729938102 HTTP/1.1 Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:48.277339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Volume tempest-invalid-729938102 could not be found. Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'tempest-invalid-729938102'} Oct 17 10:26:48.278827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-729938102 could not be found. (HTTP 404) (Request-ID: req-a577f3ae-41ed-4351-b233-5f9b019d9d32) Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.279631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:26:48.280714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-729938102 could not be found. Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:48.281741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-729938102 could not be found. Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-729938102 could not be found. Oct 17 10:26:48.284747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.289300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e96aade4-0281-453a-a4cd-1506f9e87992 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 404 to user: Volume tempest-invalid-729938102 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.290794 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e96aade4-0281-453a-a4cd-1506f9e87992 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-729938102" status: 404 len: 98 microversion: 2.1 time: 0.060819 Oct 17 10:26:48.292447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 142/265] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 17 10:26:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-729938102 => generated 98 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 10:26:48.301877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-647af693-b947-4ecc-b0d9-fa1f2a8f67e9 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003742 Oct 17 10:26:48.307236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 124/266] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 17 10:26:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 10:26:48.312332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-547b15b9-9524-42dc-8338-98e1ac02164d tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003903 Oct 17 10:26:48.312859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 143/267] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 17 10:26:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 10:26:48.322873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a8afd587-475e-461b-b960-f4703829e94a tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Calling method '.version_select at 0x7fe9ba910670>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:48.353990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-a8afd587-475e-461b-b960-f4703829e94a tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] HTTP exception thrown: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a8afd587-475e-461b-b960-f4703829e94a tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/os-volumes/7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 HTTP/1.1 Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:26:48.356176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2'} Oct 17 10:26:48.357887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. (HTTP 404) (Request-ID: req-45c81b52-1e01-4d36-bf98-f5dd189d7648) Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.358804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:26:48.360080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 10:26:48.361864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a8afd587-475e-461b-b960-f4703829e94a tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 404 to user: Volume 7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.365899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a8afd587-475e-461b-b960-f4703829e94a tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2" status: 404 len: 109 microversion: 2.1 time: 0.040714 Oct 17 10:26:48.385012 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b43d2e3-06d4-4baf-bf8c-50a219cfd5a0 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Calling method '.version_select at 0x7fe9bab0ff70>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:48.388575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 125/268] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:26:48 2022] DELETE /compute/v2.1/os-volumes/7ce8dd6b-84ea-4323-9cc1-5a65ff9ec8d2 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:26:48.436171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-9b43d2e3-06d4-4baf-bf8c-50a219cfd5a0 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] HTTP exception thrown: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b43d2e3-06d4-4baf-bf8c-50a219cfd5a0 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Request method failure captured: Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/os-volumes/af33ca5b-e5f6-48b2-a080-e8aec276f16c HTTP/1.1 Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS3nrD0A2iURyFX9GKE7U1XWAwP3JAl0Tj3srYP3-8qQTas9bM8HaXZxBdTjL9kr7kUVQfAam_dmYP2CJaqHQe_wIs6ttzrsf6ZvLupyjHXwiHINC5jBcsEAtbel3jmGTpB9e9r0fa1JJY6TJWQEyDDmsKd2O1_A7KKhccFWrCIG04E Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:48.438152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c2488861a034d2b8285e50ae6212aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0c2488861a034d2b8285e50ae6212aad Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesNegativeTest-542664502 Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: ef2bd54d094948c69d04cb62f14c9a8a Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesNegativeTest-542664502-project Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'af33ca5b-e5f6-48b2-a080-e8aec276f16c'} Oct 17 10:26:48.439540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. (HTTP 404) (Request-ID: req-2657db48-ab0e-47bd-80ea-d56755e526e8) Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.440357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:26:48.441486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 10:26:48.442669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b43d2e3-06d4-4baf-bf8c-50a219cfd5a0 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] Returning 404 to user: Volume af33ca5b-e5f6-48b2-a080-e8aec276f16c could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9b43d2e3-06d4-4baf-bf8c-50a219cfd5a0 tempest-VolumesNegativeTest-542664502 tempest-VolumesNegativeTest-542664502-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/af33ca5b-e5f6-48b2-a080-e8aec276f16c" status: 404 len: 109 microversion: 2.1 time: 0.071315 Oct 17 10:26:48.445186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 144/269] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:26:48 2022] GET /compute/v2.1/os-volumes/af33ca5b-e5f6-48b2-a080-e8aec276f16c => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:26:48.560543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:48.562385 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:48.589178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:48.591354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:48.591917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:48.594640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:48.595349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:48.597301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:48.911267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:48.921733 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-02f21a26-f617-4fb7-9d31-1beda9c23f7d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.366140 Oct 17 10:26:48.934616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 126/270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:48 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:49.068240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:49.068936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:49.085959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:49.087057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:49.088194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:49.089653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:49.090553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:49.091592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:49.190456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:49.203055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d66d577e-d727-4c7e-90e5-7571ce72fce9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1144 microversion: 2.1 time: 0.141208 Oct 17 10:26:49.222135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 145/271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:49 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1144 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:49.951639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:49.952279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:49.961642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:49.962134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:49.962626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:49.963590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:49.964044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:49.964466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:50.197217 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:50.208519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-355e92c8-72c1-4bbb-9a56-7081a87cd20d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.261500 Oct 17 10:26:50.209103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 127/272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:49 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:50.230131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:50.231131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:50.244856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:50.246037 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:50.246589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:50.247312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:50.247709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:50.248141 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:50.370239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:50.380319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6bdcba35-b84e-4aae-8aae-d3a5ca7c1b9a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1144 microversion: 2.1 time: 0.154912 Oct 17 10:26:50.380903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 146/273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:50 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1144 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:51.239848 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:51.241781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:51.265155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:51.265875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:51.268167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:51.269902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:51.270913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:51.271815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:51.404935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:51.405680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:51.418092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:51.421641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:51.423361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:51.426143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:51.431462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:51.432314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:51.559206 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:51.567692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ca67ab70-64e5-47a8-9dc4-87c62d78642d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1144 microversion: 2.1 time: 0.168031 Oct 17 10:26:51.571235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 147/274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:51 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1144 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:51.578746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:51.587500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c3e0718f-de0e-4f2d-bce6-b8a9563eaa58 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.358123 Oct 17 10:26:51.589157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 128/275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:51 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:52.594017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:52.594716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:52.604045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:52.605046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:52.605926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:52.608515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:52.609623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:52.621825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:52.624144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:52.624765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:52.638319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:52.647551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:52.648376 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:52.651803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:52.653900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:52.656977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:52.784472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:52.798593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ca2a6ffb-2ce0-47e8-bf0e-41584abd1a7b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1192 microversion: 2.1 time: 0.208861 Oct 17 10:26:52.799453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 148/276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:52 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1192 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:52.896709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:52.910555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ccf8db11-7fef-446a-a7f0-51c4d7035c6a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.298121 Oct 17 10:26:52.912025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 129/277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:52 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:53.822840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:53.824178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:53.833757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:53.836712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:53.837579 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:53.838703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:53.839380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:53.840033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:53.921568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:53.938483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:53.941551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:53.995836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9b8e1afe-2efd-4f13-8a60-fbb3ff033efe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1200 microversion: 2.1 time: 0.139908 Oct 17 10:26:54.006379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 149/278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:53 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1200 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:54.007473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.007473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.007473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.007473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.007803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.008301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.579130 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:54.596664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-77abffa0-4332-48ef-b400-ee96c245cc4c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1501 microversion: 2.1 time: 0.660725 Oct 17 10:26:54.597298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 130/279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:53 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1501 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:54.630625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57bacc27-4363-476d-9b83-f39e222ae268"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:54.643541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:54.674391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.680592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.685308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.689665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.693539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.694727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.794018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] HTTP exception thrown: Cannot 'attach_volume' instance b0a35982-9d23-4588-965f-96ea10757f72 while it is in vm_state rescued Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Request method failure captured: Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/os-volume_attachments HTTP/1.1 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 74 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1sYYDqPa3ZPabsb82n69Y41F0qIoycJWZKiTtOBwPhQy3X0yvQ0Ne200anV_Wsh-KIWYESSS9OEYllFUJzYoZQgsRv_C9mlkadCT_0bevJlxA6mKLY4lfk0qT2La-x09QrztXKi8PIhpVtNhq7jfzhH7AUNNgLuU5Fr9F3MX7ddwg Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:26:54.812248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: aaedb0e1920a42eb97e8dc2f3ec76905 Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {"volumeAttachment": {"volumeId": "57bacc27-4363-476d-9b83-f39e222ae268"}} Oct 17 10:26:54.813870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Cannot 'attach_volume' instance b0a35982-9d23-4588-965f-96ea10757f72 while it is in vm_state rescued Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'server_id': 'b0a35982-9d23-4588-965f-96ea10757f72', 'body': {'volumeAttachment': {'volumeId': '57bacc27-4363-476d-9b83-f39e222ae268'}}} Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0a35982-9d23-4588-965f-96ea10757f72 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:26:54.814922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b0a35982-9d23-4588-965f-96ea10757f72 while it is in vm_state rescued Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:26:54.816066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:26:54.817144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:26:54.817144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:26:54.817144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b0a35982-9d23-4588-965f-96ea10757f72 while it is in vm_state rescued Oct 17 10:26:54.817144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:26:54.820994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Returning 409 to user: Cannot 'attach_volume' instance b0a35982-9d23-4588-965f-96ea10757f72 while it is in vm_state rescued {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:26:54.822293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-efd15c9b-1ddc-4983-b545-876a58a0f78e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.202417 Oct 17 10:26:54.833615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:54.834453 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:54.838890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 150/280] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:26:54 2022] POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/os-volume_attachments => generated 152 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 10:26:54.841980 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.842672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.843282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.844171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.844903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.845543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.961311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7598af7c-eeb2-4707-abb0-47d12951d63e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/action" status: 202 len: 0 microversion: 2.1 time: 0.132533 Oct 17 10:26:54.972575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:54.973574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:54.976501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 131/281] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:26:54 2022] POST /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:26:54.983273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.984288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.984942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:54.986473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:54.987094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:54.987703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:55.033078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:55.037020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:55.059421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:55.060056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:55.060569 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:55.061658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:55.062944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:55.063831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:55.257523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:55.271941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-394346df-3be6-4c27-8ee1-c236b32e7ec6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1210 microversion: 2.1 time: 0.254930 Oct 17 10:26:55.273486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 132/282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:55 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1210 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:55.403365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:55.412053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8764d8ac-1761-4c01-a26a-dd51f47eefec tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.444351 Oct 17 10:26:55.412625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 151/283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:54 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:56.297882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:56.298541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:56.311321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:56.319755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:56.326676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:56.331252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:56.332766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:56.333600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:56.336246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:56.336892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:56.436875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:56.438200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:56.458314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:56.462960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:56.466820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:56.467907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:56.468387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:56.468821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:56.832031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:56.892292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:56.904988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cba407d7-6026-429b-8b6b-5102505533e3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.471902 Oct 17 10:26:56.906126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 152/284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:56 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:56.977677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:56.995867 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bd35ea30-412a-408a-ac49-a4709ec2a7f4 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.697822 Oct 17 10:26:56.998258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 133/285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:56 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:57.931963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:57.933671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:57.942612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:57.947600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:57.948345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:57.949335 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:57.950528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:57.951209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:58.021380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:58.022046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:58.046751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:58.049235 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:58.049703 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:58.050475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:58.050947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:58.051378 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:58.087074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:26:58.150801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:58.162537 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-966d8fe8-107f-45a4-baca-b7f2b87134f1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.233880 Oct 17 10:26:58.163828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 153/286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:57 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:58.297077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:58.307425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9ce878a2-fc33-4f86-8048-03ba255cc9bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.290159 Oct 17 10:26:58.308115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 134/287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:58 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:26:58.335825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12170369-6077-4716-adf0-a110aebc1525", "tag": "74d28022-6cac-4006-bf30-27fb6aed74d9"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:26:58.347932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:58.348884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:58.349529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:58.366860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] Creating event network-changed:74d28022-6cac-4006-bf30-27fb6aed74d9 for instance 12170369-6077-4716-adf0-a110aebc1525 on hv-cinder-86020 Oct 17 10:26:58.376242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-7d8aa9dd-99e9-41bf-933b-5ae80ce77e7e req-3b19a92a-57ae-4cb6-a356-9fe005bd6ea1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044729 Oct 17 10:26:58.377018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 154/288] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:26:59.187426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:59.188604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:59.195849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:59.196681 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:59.197317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:59.198030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:59.198523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:59.198952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:59.337330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:26:59.338859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:26:59.356574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:59.359179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:59.359678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:59.360116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:59.360812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:26:59.361551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:26:59.361976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:26:59.365698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4bf071e4-e9c0-4fdb-8b85-d0c5a5685c8b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.182358 Oct 17 10:26:59.369012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 135/289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:59 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:26:59.523514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:26:59.535404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0ac71b61-6bfb-4f09-8782-e4c3cd2678ec tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.206152 Oct 17 10:26:59.536006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 155/290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:26:59 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:00.391282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:00.392654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:00.400227 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:00.400962 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:00.401551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:00.402468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:00.402920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:00.403519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:00.550319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:00.560355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:00.561576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:00.561698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4fdb92f8-4cd5-4e52-8c81-33cfc3ce9640 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.174029 Oct 17 10:27:00.568084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:00.568562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:00.569428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:00.570281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:00.570910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:00.571483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:00.574866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 136/291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:00 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:00.777171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:00.786081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c5e9b9a9-8e21-47b5-adb4-43d1e365c053 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.229588 Oct 17 10:27:00.787203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 156/292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:00 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:01.586394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:01.587009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:01.593763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:01.594394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:01.594923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:01.595760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:01.596967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:01.597640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:01.768005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:01.777939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-28c6cd59-9f26-4b5b-9050-06ae521cd99d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.196175 Oct 17 10:27:01.778562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 137/293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:01 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:01.811154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:01.812193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:01.829159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:01.829909 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:01.830809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:01.832513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:01.833324 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:01.833973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:02.008025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:02.021166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d891c8c0-24b2-4f6e-8e9f-54186ce87b9c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.215618 Oct 17 10:27:02.022681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 157/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:01 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:02.807626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:02.811317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:02.816165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:02.817126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:02.817295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:02.818310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:02.822687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:02.822687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:03.003347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:03.012709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e7ba360c-0d0e-4933-a3a8-8f04f404c49c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1509 microversion: 2.1 time: 0.209292 Oct 17 10:27:03.013969 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 138/295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:02 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:03.047550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:03.049582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:03.057781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:03.058727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:03.059170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:03.059923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:03.060557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:03.060988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:03.064056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:03.234059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:03.243160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2283cd30-f9ce-45de-88d3-aa307102b438 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.202042 Oct 17 10:27:03.244343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 158/296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:03 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:03.530553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f8107ba3-c7c5-4eae-9f0b-829a20c36166 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'create', calling method: .version_select at 0x7fe9ba7fa670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1890178727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbbLNDXDJlO3y+lWH8DT1BHyJgFzP+hVBSwTzKsMHOfWaDIuhZQowkD5zAsfYyHKmAgZrbZ4zWrHh5uSnD4CyQTg3ege58hUB0Hxj+a+F6UH8exnIGvYRFh2F/pPeqetQ=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:03.551560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-f8107ba3-c7c5-4eae-9f0b-829a20c36166 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Getting quotas for project cc21860aa70345c79cfe597d5a42fb51. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:27:03.556745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-f8107ba3-c7c5-4eae-9f0b-829a20c36166 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Getting quotas for user 973791f2609b4b55aa986e9fd9baceec and project cc21860aa70345c79cfe597d5a42fb51. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:27:03.582028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f8107ba3-c7c5-4eae-9f0b-829a20c36166 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055667 Oct 17 10:27:03.582676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 139/297] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:27:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:03.711754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2056557571", "imageRef": "c282a9bc-0ce2-4e8d-905c-413b5f503024", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1890178727", "networks": [{"uuid": "f414572a-3cfd-4a03-8d0f-884b658757a5"}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:03.773366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] validate_networks() for [('f414572a-3cfd-4a03-8d0f-884b658757a5', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:27:04.041326 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:04.042751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:04.055283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.056167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.056807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.060086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.061094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.061719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.314655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:27:04.316077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:27:04.316677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:27:04.317252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:27:04.318102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:27:04.330856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.331415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.331930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.332787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.333307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.333793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.354263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Getting quotas for project cc21860aa70345c79cfe597d5a42fb51. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:27:04.359078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Getting quotas for user 973791f2609b4b55aa986e9fd9baceec and project cc21860aa70345c79cfe597d5a42fb51. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:27:04.372790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:27:04.375236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c282a9bc-0ce2-4e8d-905c-413b5f503024',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:27:04.426201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0eea5d18-5f3f-4ab5-b2fe-28e1a1bd33c1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718940 Oct 17 10:27:04.433505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 159/298] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:27:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:27:04.433505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:04.433756 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:04.442546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.442941 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.443368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.445425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:04.446515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:04.447234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:04.464509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:04.473451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8fb32f7a-a297-4c74-abbd-8a4dc3339669 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1515 microversion: 2.1 time: 0.436153 Oct 17 10:27:04.474077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 140/299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:04 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1515 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:04.480074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-552e1160-d3d8-4c66-9fc2-0bf2d150a6e7 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:04.480920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-552e1160-d3d8-4c66-9fc2-0bf2d150a6e7 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:04.548999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-552e1160-d3d8-4c66-9fc2-0bf2d150a6e7 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:04.558130 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-552e1160-d3d8-4c66-9fc2-0bf2d150a6e7 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1259 microversion: 2.1 time: 0.082694 Oct 17 10:27:04.559336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 141/300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:04 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:04.623153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:04.632607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a3f04190-72e2-45db-b0aa-1baea7129533 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.204358 Oct 17 10:27:04.633315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 160/301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:04 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:05.583212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:05.584706 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:05.592317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:05.593040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:05.593590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:05.594448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:05.595211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:05.595870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:05.656584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:05.658062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:05.665597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:05.673785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:05.674773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:05.675816 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:05.677332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:05.677948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:05.744242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:05.754932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-304791a1-bd25-4bb7-91c2-6559ed0d7bdf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1311 microversion: 2.1 time: 0.175919 Oct 17 10:27:05.755985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 142/302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:05 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:05.854285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:05.863525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-95eadc98-7c7b-4f5e-b0c9-1ea137cc2486 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.211102 Oct 17 10:27:05.864310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 161/303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:05 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:06.779213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:06.779911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:06.793356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:06.794158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:06.794641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:06.796174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:06.796637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:06.797062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:06.892287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:06.895397 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:06.902930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:06.913548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:06.914259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:06.915219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:06.915851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:06.916531 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:06.988152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:06.999218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-442b3b3f-f823-4766-9fcd-f706e8975ad6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1317 microversion: 2.1 time: 0.223776 Oct 17 10:27:06.999793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 143/304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:06 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:07.007360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-14e3bb7a-259e-4c18-8f4f-af7e2a29ad98 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: .version_select at 0x7fe9ba7fd670>, body: {"keypair": {"name": "tempest-keypair-436443746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwxbTmCtfZ4swf6PH4Qi27wa8ZefrqlW5lxyAKzCI59Kww1GOnMDcs6jiTD6pPuy5PEcwp9LYJa5SQurypWWFOYif5Ph5jbBNoT1ijNcUtGi6E/uU9TLPlLJAqu5AFMw=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:07.058550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-14e3bb7a-259e-4c18-8f4f-af7e2a29ad98 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:27:07.073728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-14e3bb7a-259e-4c18-8f4f-af7e2a29ad98 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for user aaedb0e1920a42eb97e8dc2f3ec76905 and project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:27:07.121411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-14e3bb7a-259e-4c18-8f4f-af7e2a29ad98 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117985 Oct 17 10:27:07.130994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 144/305] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:27:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:07.148618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:07.157797 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e961c8d2-2406-4795-877d-0acfc07af07a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.273725 Oct 17 10:27:07.163030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 162/306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:06 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:08.025837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:08.026576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:08.039651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:08.043400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:08.044139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:08.044977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:08.046140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:08.046702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:08.247323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:08.251188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:08.265566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:08.266359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:08.267047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:08.269177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:08.280454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:08.282478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:08.369612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:08.379170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bad74170-3273-4073-909f-3c61cb63e391 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.357917 Oct 17 10:27:08.382729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 145/307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:08 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:08.719863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:08.733594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-70cba92f-c126-4ac2-a776-76f14b36b539 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.513401 Oct 17 10:27:08.734381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 163/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:08 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:09.411250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:09.413414 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:09.421672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:09.422561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:09.423751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:09.428723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:09.429287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:09.429818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:09.584499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:09.592712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e3e33c7c-ba3f-4342-b00d-952bc051fe3b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.186048 Oct 17 10:27:09.593293 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 146/309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:09 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:09.760270 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:09.761780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:09.769162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:09.770113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:09.771099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:09.772621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:09.773351 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:09.774052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:09.821465 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2094592320", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec16a399-207c-4cf6-8c2e-ca17cef7b669"}], "security_groups": [{"name": "tempest-securitygroup--1085724265"}], "key_name": "tempest-keypair-436443746", "user_data": "}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:09.851070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:10.044524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:10.054764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1d5e643e-93ac-43e4-b0b2-f767e0c11df2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.301029 Oct 17 10:27:10.108157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 164/310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:09 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:10.617626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:10.618263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:10.625132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:10.625626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:10.626400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:10.627594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:10.628207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:10.628778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:10.778510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:10.786940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d8809254-4b00-4ce8-a7c6-7c8aa5788fbe tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.173623 Oct 17 10:27:10.788236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 165/311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:10 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:11.155275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:11.155880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:11.161258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:11.166319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:11.169513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:11.178771 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:11.180925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:11.181433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:11.183271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:11.372004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:11.379925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-148e3db7-8416-4deb-a776-73bcdd9fdd14 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.228423 Oct 17 10:27:11.380877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 166/312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:11 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:11.810915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:11.811672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:11.817467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:11.817955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:11.818409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:11.819819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:11.820372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:11.820824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:11.957361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:11.965571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7c486e37-3914-4c38-a828-08c9c24a91a1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.158593 Oct 17 10:27:11.966151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 167/313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:11 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:12.403273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:12.403918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:12.410613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:12.411251 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:12.411757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:12.413034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:12.413460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:12.413891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:12.583742 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:12.595581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d4cf4cda-7f44-4ba3-8e17-c91639bb7baa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.196012 Oct 17 10:27:12.596169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 168/314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:12 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:12.988958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:12.990581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:12.998302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:12.999231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:12.999960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:13.000947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:13.001621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:13.002263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:13.284682 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:13.295202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9b812e67-79a7-40ae-a097-7fcdd4d5440a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.308929 Oct 17 10:27:13.297175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 169/315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:12 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:13.620468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:13.621827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:13.630069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:13.630798 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:13.631468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:13.632385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:13.633036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:13.633746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:13.794872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:13.802391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c3869fa8-9623-4b85-a88d-9a70410abf0b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.187001 Oct 17 10:27:13.803056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 170/316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:13 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:14.339261 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:14.340966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:14.348371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:14.350469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:14.351317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:14.352678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:14.354063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:14.355632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:14.357115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:14.392552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:14.614504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:14.625833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3444ef7-3bfb-4f2f-ad97-160fcf817799 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.297327 Oct 17 10:27:14.631166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 171/317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:14 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:14.828287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:14.828981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:14.835566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:14.836160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:14.836769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:14.837643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:14.838067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:14.838598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:15.034389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] validate_networks() for [('ec16a399-207c-4cf6-8c2e-ca17cef7b669', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:27:15.035968 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:15.045168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-17733267-ae33-406d-af9d-6634a4778e70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.220587 Oct 17 10:27:15.045753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 172/318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:14 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:15.441372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:27:15.441939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:27:15.442460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:27:15.442880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:27:15.443988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:27:15.453978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:15.454517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:15.454959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:15.455701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:15.456162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:15.456591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:15.475555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:27:15.479693 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Getting quotas for user aaedb0e1920a42eb97e8dc2f3ec76905 and project 895b2d6d988f4ab7a0d9dcf9e130af42. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:27:15.492326 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:27:15.494831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:27:15.549632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a5d1838e-86e4-44ea-be91-28c3e4c5e2ce tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.736652 Oct 17 10:27:15.550283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 147/319] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:27:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 5738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:27:15.563777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e4be0c15-a2f4-4cff-82fa-bc88e5839c26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:15.565145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e4be0c15-a2f4-4cff-82fa-bc88e5839c26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:15.638019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e4be0c15-a2f4-4cff-82fa-bc88e5839c26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:15.645442 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e4be0c15-a2f4-4cff-82fa-bc88e5839c26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1245 microversion: 2.1 time: 0.085852 Oct 17 10:27:15.646011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 173/320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:15 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:15.658532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:15.658532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:15.664615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:15.665243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:15.665788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:15.668193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:15.668771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:15.671071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:15.890314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:15.898981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b61bf8e8-c972-46df-881c-be45b76a7de5 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.249745 Oct 17 10:27:15.900159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 148/321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:15 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:16.067547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:16.069086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:16.080610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.081356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.081983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:16.083263 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.084247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.085414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:16.236072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:16.244403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bc0614da-e8be-4f80-8429-c7f64c9bd3e9 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.180771 Oct 17 10:27:16.245074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 174/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:16 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:16.671410 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:16.672019 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:16.679140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.679625 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.680055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:16.680760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.681215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.681636 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:16.748896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:16.757167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0f1d613b-87f4-4645-913a-c1f19d806151 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.089469 Oct 17 10:27:16.757752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 149/323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:16 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:16.923061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:16.923667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:16.930920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.931394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.931822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:16.932509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:16.932955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:16.933377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:17.083885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:17.093245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-be0ba61a-5b45-4dde-93db-fa0595fb7124 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.174080 Oct 17 10:27:17.094412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 175/324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:16 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:17.270383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:17.271044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:17.279243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:17.279741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:17.280179 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:17.280888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:17.281369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:17.281780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:17.447628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:17.455609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-94acc6ea-37ba-4a55-9dc5-5feed93232c1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.192175 Oct 17 10:27:17.456183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 150/325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:17 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:17.780692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:17.781596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:17.788456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:17.788945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:17.789385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:17.790089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:17.790596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:17.791009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:17.806076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:17.853391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:17.861564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ccf8f61f-ee50-408a-97b9-e52c6989551c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.085011 Oct 17 10:27:17.862138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 176/326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:17 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:18.117544 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:18.118310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:18.124945 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.125504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.126049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.126846 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.127305 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.127729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.268719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:18.277226 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-45328d30-49a2-4cf6-bc66-bf24f49e7234 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.164549 Oct 17 10:27:18.277803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 151/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:18 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:18.478785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:18.479387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:18.485457 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.485941 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.486396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.487094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.487548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.487969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.634078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:18.641914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a63372da-5d7d-43b9-b441-aab40cf530d6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.167617 Oct 17 10:27:18.642506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 177/328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:18 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:18.886870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:18.887379 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:18.893359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.893843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.894273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.894999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:18.895454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:18.895871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:18.960759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:18.968489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8036da04-ae44-4f79-87e0-e225d8257a22 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.085607 Oct 17 10:27:18.969059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 152/329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:18 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:19.300103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:19.300700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:19.307745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:19.308219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:19.308645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:19.309323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:19.309770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:19.310189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:19.438989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:19.446967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-08044217-f3da-45c3-89b2-57fdd0799118 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.150640 Oct 17 10:27:19.447525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 178/330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:19 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:19.665320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:19.665889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:19.671893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:19.672384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:19.672818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:19.673505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:19.673962 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:19.674418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:19.803464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:19.811128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-235a2cee-a2fa-4239-86b7-e118b7f5b088 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.150412 Oct 17 10:27:19.811939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 153/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:19 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:19.997079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:19.997686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:20.003869 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.004348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.004775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.005460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.006419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.007365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.068258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:20.076637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-656f4d18-1061-465a-891d-a5e3fa768858 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.083586 Oct 17 10:27:20.077281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 179/332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:19 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:20.469940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:20.470578 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:20.477071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.477557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.477992 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.478959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.479414 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.479859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.603843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:20.607232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:20.612341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-99b8b638-92b1-4b57-921e-ba7f1a10aa5d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.146275 Oct 17 10:27:20.612908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 154/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:20 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:20.835852 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:20.836362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:20.842234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.842745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.843173 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.843851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:20.844297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:20.844715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:20.983377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:20.991337 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6fbda543-902c-40ba-911b-c42551dcb125 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.159860 Oct 17 10:27:20.991903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 180/334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:20 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:21.098916 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:21.099531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:21.107628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:21.108110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:21.108538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:21.109225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:21.109675 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:21.110095 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:21.173726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:21.181482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d2ced9ff-1e1c-4167-8991-4d89fd56350d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.086364 Oct 17 10:27:21.182039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 155/335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:21 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:21.635981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:21.636593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:21.642764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:21.643250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:21.643690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:21.644409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:21.644917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:21.645293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:21.773476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:21.781031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a22dcad4-3e5d-4fff-91b4-a01567ef48e3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.149010 Oct 17 10:27:21.781636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 181/336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:21 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:22.013472 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:22.014087 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:22.020116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.020631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.021065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.021813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.022404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.022834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.155151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:22.163340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b9730ae9-737a-476d-a9f0-b6a4de8e8bf1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.153736 Oct 17 10:27:22.163913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 156/337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:22 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:22.203894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:22.204491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:22.210831 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.211306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.211733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.212407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.212853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.213268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.274422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:22.281890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e9d6d059-6034-4de5-ad8d-46f7dbf6e5a7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.081744 Oct 17 10:27:22.282475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 182/338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:22 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:22.803304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:22.803942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:22.809960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.810476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.810914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.811680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:22.812230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:22.812698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:22.945746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:22.953350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1fdb9900-f873-4463-ac33-193e18b4f869 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.153983 Oct 17 10:27:22.953918 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 157/339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:22 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:23.186574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:23.187174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:23.193055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.193642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.194073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:23.195507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.195954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.196375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:23.308844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:23.309444 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:23.315812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.316301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.316753 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:23.317651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.318111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.318605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:23.332477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:23.340961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-38aa0361-d134-45f0-a6b4-9e9313a6bd8b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.158211 Oct 17 10:27:23.346068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 183/340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:23 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:23.384971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:23.392654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-781d1576-b550-4449-960f-69974019d91d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.091671 Oct 17 10:27:23.393260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 158/341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:23 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:23.977348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:23.977950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:23.984200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.984678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.985103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:23.985785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:23.986234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:23.986676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:24.113602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:24.121825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-73911c22-7a2d-49ec-b475-9568c272e9d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.148871 Oct 17 10:27:24.122570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 184/342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:23 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:24.363758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:24.364439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:24.372689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:24.373181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:24.373616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:24.374388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:24.374945 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:24.375476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:24.415157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:24.415755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:24.421850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:24.422749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:24.423350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:24.424545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:24.425301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:24.425739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:24.495957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:24.505135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9b740c3f-d8dc-4798-a64f-83e5282596e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.093931 Oct 17 10:27:24.505718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 185/343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:24 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:24.524817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:24.533819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-497e4a26-9694-4264-8ae1-849216a25ec2 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.173836 Oct 17 10:27:24.534489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 159/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:24 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:25.144807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:25.145412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:25.151427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.151908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.152340 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.153029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.153480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.153902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.281649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:25.289834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-aadc6630-60cd-4fdd-b772-41433ec223d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.148830 Oct 17 10:27:25.290420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 186/345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:25 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:25.529946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:25.530597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:25.532896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:25.533719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=16 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:25.539262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.539788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.540264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.540960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.541553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.541979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.555959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:25.556569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:25.562853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.563432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.563964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.564836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:25.565410 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:25.565903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:25.617284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:25.625333 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e563fc8e-626e-430a-9a1b-48d74ceb3ef5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.099212 Oct 17 10:27:25.626463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 160/346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:25 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:25.642584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:25.712740 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:25.721093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d73d4ec9-3e56-4983-abc6-7718ffefc62a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.168825 Oct 17 10:27:25.721738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 187/347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:25 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:26.312109 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:26.312755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:26.318734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.319215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.320224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:26.321035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.321496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.321920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:26.453064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:26.461026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-86e9c15a-f1a9-48cb-8193-caae132b0cc6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.152794 Oct 17 10:27:26.461593 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 161/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:26 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:26.648552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:26.649164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:26.655724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.656221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.656658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:26.657423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.657880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.658371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:26.727481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:26.735638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-069e8d2f-404b-4530-b277-2651bc50928a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.091167 Oct 17 10:27:26.736359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 188/349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:26 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:26.755705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:26.756318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:26.764584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.765382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.766543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:26.767415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:26.768046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:26.768475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.002844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:27.010672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ee2c61ac-7ffb-413d-88f0-1dd43fb41d70 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.259029 Oct 17 10:27:27.011246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 162/350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:26 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:27.383809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:27.393156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:27.393623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:27.394049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.405771 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] Creating event network-changed:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:27:27.410722 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-113d3381-52aa-49f7-92b9-e6b5a29999c5 req-95529274-aa6a-464c-b7dc-ec3adb66d6fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031012 Oct 17 10:27:27.411511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 189/351] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:27.484059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:27.484668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:27.490645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:27.491127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:27.491563 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.492251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:27.492702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:27.493126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.621120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:27.628891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-99b44978-6b4a-418c-a968-0aa07438f9f9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.148624 Oct 17 10:27:27.629467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 163/352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:27 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:27.760749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:27.761474 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:27.767513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:27.767994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:27.768425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.769108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:27.769558 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:27.769981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:27.831665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:27.839314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8de9d2a7-f67a-4933-b86d-64f3efc59438 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.083402 Oct 17 10:27:27.839879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 190/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:27 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:28.033003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:28.033617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:28.040784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.041275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.041712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.042436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.042894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.043320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.176722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:28.185072 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8080d04d-ebca-475c-9ca3-2ef10600d15c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.155950 Oct 17 10:27:28.185634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 164/354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:28 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:28.652488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:28.653101 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:28.659072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.659557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.659994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.660684 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.661138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.661564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.789323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:28.796880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ac9ecc56-9f53-4353-8a14-3ba89b6ff60e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.149016 Oct 17 10:27:28.797445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 191/355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:28 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:28.860814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:28.861424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:28.867288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.867764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.868194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.868872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:28.869324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:28.869744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:28.931023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:28.938641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4f438410-f399-4220-a16b-964f20b9b527 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.081615 Oct 17 10:27:28.939186 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 165/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:28 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:29.208278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:29.208278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:29.214228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.214745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.215177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:29.215859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.216309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.216726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:29.349392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:29.357363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-391cc135-327b-48ae-88d0-2a1076d9ed28 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.153770 Oct 17 10:27:29.357920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 192/357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:29 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:29.820028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:29.820639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:29.826942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.827419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.827855 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:29.828532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.828982 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.829399 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:29.957321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:29.961356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:29.961963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:29.965581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7a964fcc-4b04-4d79-a612-977bc8dd9a90 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.149705 Oct 17 10:27:29.966159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 166/358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:29 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:29.967794 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.968276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.968709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:29.969403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:29.969862 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:29.970285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:30.032126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:30.034412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:30.042512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b9080a53-511c-422a-949b-99a87c181bbc tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.085371 Oct 17 10:27:30.043083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 193/359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:29 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:30.380658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:30.381196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:30.387768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:30.388252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:30.388698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:30.389373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:30.389828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:30.390248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:30.522467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:30.530541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6bc05cf4-3821-4073-9d9e-51d2f3c3507f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.153783 Oct 17 10:27:30.531106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 167/360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:30 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:30.988989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:30.989617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:30.996333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:30.996817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:30.997253 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:30.997947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:30.998428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:30.998853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:31.065096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:31.065836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:31.072430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:31.072914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:31.073344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:31.074246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:31.074995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:31.075424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:31.130670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:31.138045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:31.138538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-85386680-d1b9-473c-bc09-ce77402f6884 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.153378 Oct 17 10:27:31.139121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 194/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:30 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:31.146173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bba9ef69-546c-4ab7-968f-68a115c392b6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.085052 Oct 17 10:27:31.146766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 168/362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:31 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:31.553411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:31.554054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:31.559944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:31.560423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:31.560855 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:31.561535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:31.561987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:31.562433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:31.696028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:31.703748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9119da80-7ba0-468f-92b2-1cc8a706f74c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.154240 Oct 17 10:27:31.704321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 195/363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:31 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:32.160890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:32.161487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:32.168218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:32.168821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:32.171397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.171892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.172325 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.173014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.173471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.173892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.174703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.175187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.175621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.176310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.176870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.177293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.239704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:32.247325 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cacbe7ae-c972-4341-8eb5-cc52af3590b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1249 microversion: 2.1 time: 0.082965 Oct 17 10:27:32.247905 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 196/364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:32 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:32.305230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:32.312904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a941859f-e489-44fd-adce-703d32450fc1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.155846 Oct 17 10:27:32.313466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 169/365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:32 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:32.726693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:32.727302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:32.733416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.733895 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.734344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.735038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:32.735490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:32.735912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:32.865545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:32.873889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e9915401-34f0-4988-9385-43067ed2c1d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.151078 Oct 17 10:27:32.874480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 197/366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:32 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:33.280588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:33.283112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:33.301977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.303215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.305202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.306531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.307363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.308104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.335838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:33.337404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:33.344080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.344664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.345277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.346044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.346708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.347209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.431037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:33.446956 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f8b7de3d-b140-4ee4-a055-c0bf6d73483c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1297 microversion: 2.1 time: 0.178267 Oct 17 10:27:33.454232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 170/367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:33 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:33.495363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:33.502925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cb5c163a-ae4a-4e4f-8617-33b6447921bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.171492 Oct 17 10:27:33.503490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 198/368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:33 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:33.897204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:33.898260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:33.905597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.906184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.906722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.907565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:33.908163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:33.908771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:33.930233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:34.242803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:34.250561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e33cd008-7489-4f48-9a56-06593c95f314 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.357319 Oct 17 10:27:34.251129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 171/369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:33 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:34.469746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:34.470267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:34.476332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:34.476840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:34.477287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:34.477977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:34.478716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:34.479142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:34.527193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:34.527879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:34.534381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:34.534939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:34.535443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:34.536220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:34.536816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:34.537259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:34.541408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:34.549069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7571f34e-7960-4254-a8e4-3e3368b91c42 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1297 microversion: 2.1 time: 0.083154 Oct 17 10:27:34.549848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 199/370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:34 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:34.667318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:34.674823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9c2e889a-ba02-4cc1-a0bf-2ead5842e9f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.152072 Oct 17 10:27:34.675382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 172/371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:34 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:35.273013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:35.274178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:35.280168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.280653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.281084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.281770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.282224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.282683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.414067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:35.421971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0e91ed0e-5376-4411-8ac1-27b2f8811764 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.152870 Oct 17 10:27:35.422570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 200/372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:35 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:35.571890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:35.573521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:35.580050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.580531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.580965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.581649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.582107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.582580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.648250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:35.657098 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f040a396-8ebb-473e-b3e0-4b652c0b914f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1297 microversion: 2.1 time: 0.088990 Oct 17 10:27:35.657689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 173/373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:35 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:35.697187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:35.698560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:35.704489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.704965 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.705436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.706128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:35.706609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:35.707033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:35.840817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:35.848488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ac0430bb-140b-48e0-a753-2f19e47427f3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.155101 Oct 17 10:27:35.849057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 201/374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:35 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:36.444594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:36.445127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:36.451627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.452115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.452574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:36.453291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.453755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.454182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:36.585738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:36.593999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7e4a8028-6d1d-47e5-96dd-06efc7c2b589 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.153339 Oct 17 10:27:36.595042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 174/375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:36 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:36.679969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:36.680582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:36.686731 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.687216 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.687755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:36.688489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.688946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.689375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:36.752482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:36.760224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-39b274cb-e4e7-44c6-99b4-1adedf03eff6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1297 microversion: 2.1 time: 0.083988 Oct 17 10:27:36.760765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 202/376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:36 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:36.872729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:36.873334 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:36.879468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.879950 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.880381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:36.881066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:36.881515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:36.881935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:37.013281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:37.020895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-131cd00c-8956-426d-9603-fa668fadbf06 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.152627 Oct 17 10:27:37.021462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 175/377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:36 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:37.617267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:37.617868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:37.624455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:37.624922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:37.625346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:37.626019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:37.626489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:37.626906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:37.754779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:37.762524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b88c7d2a-14a1-49df-a2fd-d1fc808500d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.149034 Oct 17 10:27:37.763082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 203/378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:37 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:37.783728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:37.784340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:37.790712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:37.791195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:37.792196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:37.792840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:37.793298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:37.793728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:37.856057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:37.864248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4b1404f6-a2a7-4692-9dc4-c1e5328a64b2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1297 microversion: 2.1 time: 0.084400 Oct 17 10:27:37.865055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 176/379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:37 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:38.046647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:38.047504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:38.055486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.056257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.056918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:38.058121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.058841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.059504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:38.312597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:38.320445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-79b581b3-2c9d-479e-a1ae-2e5a615b05d6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.279738 Oct 17 10:27:38.320999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 204/380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:38 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:38.785023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:38.785635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:38.798631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.799375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.799827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:38.800522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.800978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.801398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:38.890911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:38.892365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:38.906941 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.907435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.907881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:38.908585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:38.909039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:38.909467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:39.060738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:39.085182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-989337a1-c4f0-45f2-aee4-14d310433979 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1303 microversion: 2.1 time: 0.199963 Oct 17 10:27:39.086502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 205/381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:38 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:39.100809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:39.113640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4cb3f5e8-55bc-4471-8cb8-08cd9ca760bf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.332506 Oct 17 10:27:39.115397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 177/382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:38 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:39.344010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:39.344628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:39.357855 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:39.358453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:39.358993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:39.362960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:39.363618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:39.364648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:39.565131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:39.573612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-17b79eea-a9cf-4b3a-9da4-5ebada80624b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.234301 Oct 17 10:27:39.574290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 206/383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:39 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:40.115257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:40.115993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:40.118504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:40.124570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.125062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.125502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.126194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.126719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.127142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.137288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:40.137908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:40.144637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.145258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.145699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.146481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.146923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.147658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.263020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:40.271744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-70d8bdbb-43b8-49cf-9f33-b0528571fda1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.160048 Oct 17 10:27:40.272831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 178/384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:40 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:40.298050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:40.305641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d02a9e5a-188d-458f-9d86-d14999f0f41d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.172608 Oct 17 10:27:40.306217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 207/385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:40 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:40.597947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:40.598598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:40.605995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.606658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.607105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.607813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:40.608278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:40.608707 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:40.796163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:40.804942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-287bf251-cbaa-468c-8894-e74bd39f286d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.211927 Oct 17 10:27:40.805925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 179/386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:40 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:41.041976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12170369-6077-4716-adf0-a110aebc1525", "name": "network-vif-plugged", "status": "completed", "tag": "74d28022-6cac-4006-bf30-27fb6aed74d9"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:41.054385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.055085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.055733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.068891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] Creating event network-vif-plugged:74d28022-6cac-4006-bf30-27fb6aed74d9 for instance 12170369-6077-4716-adf0-a110aebc1525 on hv-cinder-86020 Oct 17 10:27:41.080229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-b4d8b071-9953-4079-9030-d2fbd8628cd7 req-0060df57-f222-441b-8373-656e7790ee23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042342 Oct 17 10:27:41.080836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 208/387] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:27:41.296800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:41.297517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:41.304604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.305104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.305571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.306277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.306786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.307743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.333033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:41.333995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:41.336128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=88 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:41.343462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.344340 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.344850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.345643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.346205 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.346891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.446944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:41.455793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c16b46a5-5df5-424a-a952-a22c96910f67 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.163261 Oct 17 10:27:41.456426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 180/388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:41 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:41.493813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:41.502310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c1b299bb-edd9-44c3-8934-82899fab215a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.173794 Oct 17 10:27:41.502907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 209/389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:41 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:41.827793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:41.828416 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:41.834620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.835108 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.835539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.836226 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:41.836678 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:41.837102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:41.965325 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:41.972847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3a1a31a8-55f5-4e07-82d9-23d100d28a19 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.148917 Oct 17 10:27:41.973405 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 181/390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:41 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:42.479366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:42.479917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:42.485612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:42.486097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:42.486577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:42.487269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:42.487723 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:42.488147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:42.524554 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:42.525156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:42.532128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:42.532683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:42.533111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:42.533800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:42.534251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:42.534697 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:42.686973 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:42.688244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:42.694891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f578046a-570d-4254-8f37-d358274ef094 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.174078 Oct 17 10:27:42.695470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 182/391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:42 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:42.697447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4b56c8fb-2def-4d37-89ea-d5f436225a01 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.222549 Oct 17 10:27:42.698897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 210/392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:42 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:42.998216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:42.998862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:43.007741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.008617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.009427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.010803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.011666 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.012128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.203207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:43.211232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6f40273f-b241-4f8f-8eb2-0c1defff3735 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.217721 Oct 17 10:27:43.211892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 183/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:42 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:43.315697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:43.330506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.330506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.330506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.333033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:43.349765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] Creating event network-changed:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:27:43.358278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-2b85cb92-610b-4e46-9e29-31e169be4fca req-c964bfc5-c31a-4c85-8ee8-91e67f9b7d78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Oct 17 10:27:43.359122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 211/394] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:43.719518 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:43.720288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:43.721145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:43.721846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:43.727240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.727815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.728671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.729213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.730770 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.730889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.731222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.731351 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.731781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.731927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:43.732543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:43.733183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:43.870946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:43.874041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:43.878878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2f712ed7-b5a8-4351-8f45-64d71af47856 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.163513 Oct 17 10:27:43.879450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 184/395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:43 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:43.881698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-370b4dd1-ad38-41a7-8b42-d871e4e0697d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.164936 Oct 17 10:27:43.882244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 212/396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:43 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:44.234718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:44.235252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:44.242553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.243273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.243836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:44.245333 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.246342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.246777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:44.381096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:44.389253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-44a37c9a-f7df-45c1-91d2-a15e25a4a336 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.158554 Oct 17 10:27:44.389825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 185/397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:44 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:44.904354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:44.904932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:44.905293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:44.906045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:44.913247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.913738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.914217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.914645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.914794 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:44.915398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:44.916053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.917093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:44.917209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.917745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:44.918039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:44.918701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:45.064706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:45.073481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e157d436-53eb-400f-baf4-bb485cf7952d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1266 microversion: 2.1 time: 0.173625 Oct 17 10:27:45.074611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 213/398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:44 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:45.160551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:45.170404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f7ea1e01-599c-4a21-82e2-a24bad718a0c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.270536 Oct 17 10:27:45.170984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 186/399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:44 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:45.412779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:45.413417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:45.419889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:45.420373 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:45.420999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:45.421716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:45.422172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:45.422687 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:45.555838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:45.559307 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "name": "network-vif-plugged", "status": "completed", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:45.564466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-78f99fda-7df9-48e2-afbb-bcbc88d05ea8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.156554 Oct 17 10:27:45.565308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 214/400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:45 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:45.570308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:45.570820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:45.571255 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:45.583757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] Creating event network-vif-plugged:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:27:45.588974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-80f9d2e5-b843-4ee8-82ae-2151142707cb req-d7dd7526-22b2-464d-b24c-8721f2cbf9f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034401 Oct 17 10:27:45.589571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 187/401] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:27:46.098901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:46.099513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:46.105959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.106475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.106911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.107598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.108063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.108488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.193301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:46.194136 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:46.201031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.201519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.201959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.202765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.203224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.203652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.242917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:46.251997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3c48db7-006a-4707-8680-d88c07f0cb41 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1453 microversion: 2.1 time: 0.156905 Oct 17 10:27:46.252679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 215/402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:46 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:46.275936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:46.276551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:46.282579 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.283071 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.283515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.284217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.284667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.285092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.344979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:46.348821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:46.354487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2c683f9b-7a98-4aef-a4b7-bc5971650c7b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.165817 Oct 17 10:27:46.355092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 188/403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:46 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:46.552865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:46.561461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2d2b4482-7cc9-42e0-a116-0ea4b5c744c5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1453 microversion: 2.1 time: 0.289343 Oct 17 10:27:46.562025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 216/404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:46 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1453 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:46.588156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:46.588806 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:46.594758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.595240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.595669 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.596363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:46.596819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:46.597240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:46.729593 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:46.737608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bd76383c-1144-4f05-ba54-445300b1fe0a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.153549 Oct 17 10:27:46.738183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 189/405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:46 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:47.378640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:47.379188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:47.385469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:47.386104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:47.386575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:47.387268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:47.387719 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:47.388142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:47.519612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:47.528531 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-56549c9f-dcd7-463a-9eaf-9e7cdca27181 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.153713 Oct 17 10:27:47.539321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 217/406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:47 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:47.761582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:47.762188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:47.768791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:47.769275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:47.769705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:47.770425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:47.770882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:47.771306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:48.240983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:48.249856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-627dbdcb-4518-4614-8b94-2b7c7a3c40df tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.492779 Oct 17 10:27:48.250644 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 190/407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:47 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:48.551444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:48.552150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:48.562075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:48.562649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:48.563176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:48.563942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:48.564824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:48.564824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:48.640051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12170369-6077-4716-adf0-a110aebc1525", "tag": "74d28022-6cac-4006-bf30-27fb6aed74d9"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:48.668775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:48.669258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:48.669687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:48.681331 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] Creating event network-changed:74d28022-6cac-4006-bf30-27fb6aed74d9 for instance 12170369-6077-4716-adf0-a110aebc1525 on hv-cinder-86020 Oct 17 10:27:48.686572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-221e5705-9225-4b23-944c-ef5174aa4dd4 req-5a08fcf4-06dd-4c95-92b2-f26d4ba0ce32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051469 Oct 17 10:27:48.687559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 191/408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:27:48.710628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:48.719113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a4280aea-c07f-468a-b1ce-f0b6ae301e32 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.171451 Oct 17 10:27:48.719685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 218/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:48 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:49.274111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:49.274835 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:49.281013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:49.281498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:49.281935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:49.282655 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:49.283106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:49.283529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:49.414671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:49.422805 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bd98bf37-f840-4840-94ff-48ff5c603798 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.153398 Oct 17 10:27:49.423373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 192/410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:49 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:49.742842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:49.743403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:49.750659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:49.751130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:49.751527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:49.752215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:49.752702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:49.753118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:49.883488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:49.891402 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fb218d1d-2d77-4c77-903e-1d66ecf2673d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.152762 Oct 17 10:27:49.891967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 219/411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:49 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:50.447845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:50.448971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:50.454980 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:50.455493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:50.455953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:50.456636 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:50.457114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:50.457531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:50.588695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:50.596350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bdde12c0-3498-4e93-abde-23d5b89b694e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.153047 Oct 17 10:27:50.596911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 193/412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:50 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:50.914035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:50.914713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:50.920738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:50.921216 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:50.921646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:50.922344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:50.922801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:50.923225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:51.053476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:51.061741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f969db36-cb35-4f86-a898-a34a2d0875e0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.151550 Oct 17 10:27:51.062340 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 220/413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:50 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:51.618555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:51.619142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:51.625713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:51.626207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:51.626648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:51.627332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:51.627781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:51.628231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:51.757850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:51.767085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-df08b8f9-4676-49e3-abb3-4809bdbe7d51 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.152403 Oct 17 10:27:51.767673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 194/414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:51 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:52.086214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:52.086874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:52.093506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:52.093995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:52.094461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:52.095149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:52.095602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:52.096026 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:52.235916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:52.243600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-484c0cb7-c66a-408e-b1b6-b67bd1053399 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.161411 Oct 17 10:27:52.246922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 221/415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:52 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:52.793218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:52.793952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:52.801343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:52.802257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:52.802830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:52.803778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:52.804420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:52.804844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:52.952218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:52.960943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-57075cf7-d4a4-42a6-9d35-0b2f10a94b5c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.173424 Oct 17 10:27:52.961732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 195/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:52 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:53.267021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:53.267626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:53.274001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:53.274628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:53.275102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:53.276558 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:53.277160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:53.277591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:53.428685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:53.437806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1125ee9b-959d-437c-b03f-57757ce5ce6f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.174659 Oct 17 10:27:53.438405 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 222/417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:53 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:53.986357 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:53.986981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:54.000184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:54.000876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:54.001590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:54.002556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:54.003816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:54.004446 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:54.298542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:54.306656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9cafecea-b524-4ce6-8698-a2a1cc2ecd6f tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.324924 Oct 17 10:27:54.307841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 196/418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:53 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:54.461145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:54.461779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:54.468608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:54.469095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:54.469530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:54.470264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:54.470751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:54.471178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:54.636926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:54.646729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-acbd7295-5f13-42cd-9196-2804681206f0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.188980 Oct 17 10:27:54.647019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 223/419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:54 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:55.334541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:55.335366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:55.342661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:55.343222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:55.343587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:55.344290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:55.344804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:55.345173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:55.637548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:55.654017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f54dc9ca-dc8d-40b8-badd-0697b6ad5a10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1359 microversion: 2.1 time: 0.320999 Oct 17 10:27:55.656091 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 197/420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:55 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:55.669709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:55.670344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:55.678409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:55.679092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:55.679800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:55.680676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:55.681547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:55.682196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:55.977194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:55.985127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-aa0ec671-ffdc-4220-b42b-0ac8928b195f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.319156 Oct 17 10:27:55.985580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 224/421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:55 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:56.679939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:56.680548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:56.687713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:56.688369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:56.688836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:56.689533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:56.689994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:56.690511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:56.830175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:56.839795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-64fbed15-710c-479c-ace0-f8ad9df7f774 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1548 microversion: 2.1 time: 0.163446 Oct 17 10:27:56.840527 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 198/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:56 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:56.866935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:56.867543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:56.874994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:56.875475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:56.876096 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:56.876930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:56.877231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:56.877648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.016664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:57.017493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:57.024341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.024968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.026230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.027399 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.027971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.028565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.039360 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:57.048827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-14aa5e10-0a68-4c81-a783-e8e638e886b8 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1548 microversion: 2.1 time: 0.187875 Oct 17 10:27:57.051403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 225/423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:56 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:57.072152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:57.078284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:57.079404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Searching by: {'deleted': False, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51'} {{(pid=118679) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 10:27:57.090494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.091066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.091580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.092391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.092921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.093421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.186748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:57.195148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c85745aa-dc60-42bf-bc37-9b0ec31c95b1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.189976 Oct 17 10:27:57.196052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 199/424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:57 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:27:57.218307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.multi_cell_list [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 10:27:57.326199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d06d071c-a4ed-4129-83bc-8651c89a1ceb tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.258913 Oct 17 10:27:57.326819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 226/425] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 17 10:27:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:57.339013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:57.339624 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:57.345489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.345972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.346435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.347170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.347635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.348062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.486575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:57.495175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-175416f0-756c-4fa9-a269-506b0855d8bf tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1548 microversion: 2.1 time: 0.159956 Oct 17 10:27:57.495714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 200/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:57 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:57.647457 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "name": "network-vif-plugged", "status": "completed", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:57.660817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:57.661585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:57.663982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:57.681370 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] Creating event network-vif-plugged:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:27:57.695118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-7aa102c2-c279-472c-8f6f-61364e2ad8da req-dfc95cf2-3ca2-4e9a-b2a8-54370cdaa614 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054151 Oct 17 10:27:57.697146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 227/427] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:58.221370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:58.223581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:58.232780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:58.233627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:58.235715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:58.236428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:58.236885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:58.237310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:58.393257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:58.403161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fd2832a9-e250-4c33-9849-72f97f5ef1c9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.187139 Oct 17 10:27:58.403948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 201/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:58 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:27:59.183266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9de49492-d44c-49fc-ba30-c85248d49547"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:27:59.185977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:59.193626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:59.194357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:59.194786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:59.195524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:59.195979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:59.196573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:59.280588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:27:59.438355 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:27:59.439027 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:27:59.451818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:59.452443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:59.452959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:59.453830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:27:59.454390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:27:59.454888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:27:59.591864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c3565648-5894-46cd-9a1c-11666f075423 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413926 Oct 17 10:27:59.598690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 228/429] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:27:59 2022] POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:27:59.657645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:27:59.668585 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-eb009fe8-7de7-40b6-9aa9-d2d273ceb0f7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1371 microversion: 2.1 time: 0.244137 Oct 17 10:27:59.669321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 202/430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:27:59 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:28:00.695430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:00.696182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:00.707886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:00.708378 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:00.708811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:00.709515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:00.709969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:00.710411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:00.981119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:00.989955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-410b4ed0-a5c1-4dab-8e85-7da174f7197d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1565 microversion: 2.1 time: 0.299148 Oct 17 10:28:00.991073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 229/431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:00 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1565 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:01.020253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:01.021331 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:01.028897 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:01.029645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:01.030466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:01.031369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:01.031985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:01.032574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:01.144730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2ffff212-5f26-476d-bbdc-6b76d139c2f9 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128563 Oct 17 10:28:01.145340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 203/432] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:28:01 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:02.624073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:02.634442 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:02.635870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:02.636425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:02.651008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] Creating event network-changed:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:28:02.656732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-5fffdb45-f149-4bf4-a0af-329707ab830c req-125c08c3-5cf0-4ce2-b178-03d844c15d64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Oct 17 10:28:02.657998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 230/433] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:08.644232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:08.644929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:08.667757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:08.668262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:08.668694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:08.669587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:08.670426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:08.671016 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:09.281243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:09.291260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e80f6b9a-47e7-4286-86d0-8c232a24598d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1594 microversion: 2.1 time: 0.650599 Oct 17 10:28:09.292412 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 204/434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:08 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1594 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:11.186623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:11.439140 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Action: 'create', calling method: .version_select at 0x7fe9ba7ee310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1451062318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiAMUojB9/Su+bGD9gpNbCgxEaTtul64wA6L/rpE9XCXK31c13PLCJJrtEUKqSmB4euVl8PjpSmgjAg/GPqpV/JekKb1lxEC1QaOvglACLie/ms5G9zTrytfHOwx7EhYA=="}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:11.444484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=44 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:11.456884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Getting quotas for project 8ca835fdc95849cd8db1882ebb693cc3. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:28:11.461376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Getting quotas for user 75018aeecd6843c0a75bc95e8757fd8a and project 8ca835fdc95849cd8db1882ebb693cc3. Resources: {'key_pairs'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:28:11.474300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [eff9e69d-7b8a-4ec8-9ad7-17c9b4b84e3b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 10:28:11.956739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:11.972224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=54 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:11.982487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:11.983239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:11.983766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:11.999825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] Creating event network-changed:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:28:12.005641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-35ef0f8e-c1b9-4757-910a-627ae6bfff68 req-1f8fb9ea-9d4c-4f30-b83e-b462e4914d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052506 Oct 17 10:28:12.006560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 205/435] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:12.482864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [eff9e69d-7b8a-4ec8-9ad7-17c9b4b84e3b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55300. Oct 17 10:28:12.507361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ac49f034-08d0-4789-8604-a5564e8ded12 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.332777 Oct 17 10:28:12.515838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 231/436] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:28:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:13.694913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-75946106"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:13.695629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:13.707403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:13.708055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:13.709908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:13.710773 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:13.711318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:13.711914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:13.877691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.network.security_group_api [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Adding security group ada0ccf3-d083-438e-a1ca-038111f8b652 to port 9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 Oct 17 10:28:14.331861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-594b61b3-2e40-4bd5-9559-d1b06f799c38 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action" status: 202 len: 0 microversion: 2.1 time: 0.643246 Oct 17 10:28:14.332758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 206/437] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:28:13 2022] POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:28:14.341846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:14.342993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:14.346681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:14.353703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:14.354214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:14.354861 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:14.355601 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:14.356115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:14.356491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:14.362395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:14.376673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:14.377411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:14.377568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:14.409298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] Creating event network-changed:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:28:14.417292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-453fc73d-ce20-4a3f-922d-630e0f3cb3e6 req-51350dc5-1ba6-4e4c-9e12-f90ed730bc48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058419 Oct 17 10:28:14.417895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 207/438] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:14.592047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:14.602518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7c0ea4f3-b712-40fe-b6be-dfd33567c219 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1758 microversion: 2.1 time: 0.265518 Oct 17 10:28:14.605002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 232/439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:14 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:27.470592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:27.471204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:27.473684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=5 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:27.474359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=98 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:27.481521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:27.482022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:27.482591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:27.483281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:27.483738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:27.484162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:27.508810 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dc783bb4-858d-482f-b0ed-1793155cb618 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/ips" status: 200 len: 150 microversion: 2.1 time: 0.042456 Oct 17 10:28:27.509384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 208/440] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:28:27 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:27.842118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:27.842755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:27.845215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=4 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:27.845871 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:27.846604 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:27.851824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:27.852312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:27.852743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:27.853691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:27.854145 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:27.854596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:27.881094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e94aadf9-1295-422c-8224-856259830c4b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/ips" status: 200 len: 146 microversion: 2.1 time: 0.043476 Oct 17 10:28:27.881658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 233/441] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:28:27 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:29.943462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "590fcfe6-add0-404f-8ba4-b387c78bf006"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:29.945771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:29.952443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:29.952934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:29.953364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:29.954102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:29.954591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:29.955013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:30.259755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-186466ae-f002-4ad5-ba08-8a8713ebea5b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319950 Oct 17 10:28:30.260375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 209/442] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:28:29 2022] POST /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:28:31.387042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42b1e80d-8c3d-4483-8c83-e5d7c770ff55"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:31.387042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:31.392091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:31.392568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:31.392997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:31.393675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:31.394119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:31.394573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:31.689002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6dff2a47-9146-4cf6-b079-cbfeecdb2955 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309297 Oct 17 10:28:31.689950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 234/443] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:28:31 2022] POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:37.825370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c67e777f-981f-4e5a-809c-0308939a056c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: .version_select at 0x7fe9ba7c70d0>, body: {"keypair": {"name": "tempest-keypair-987499390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgLHkFbZv8nEv9XVzeJsD8yv5dzS4cCZgKZc2+xXfN+iJrTck5p+v96rY6Ya7epGhNuYix5g70EdTSurIFs527g3A1l7pwTe+o0x3N7SMKGa9J9IV15fCpdHcRO8/qHYw=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:37.841233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-c67e777f-981f-4e5a-809c-0308939a056c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:28:37.845792 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-c67e777f-981f-4e5a-809c-0308939a056c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:28:37.867569 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c67e777f-981f-4e5a-809c-0308939a056c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047483 Oct 17 10:28:37.868155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 210/444] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:28:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:39.139350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1394472097", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad62b422-f6a9-44d6-866f-37a78f2fcbac"}], "security_groups": [{"name": "tempest-securitygroup--1240267214"}], "key_name": "tempest-keypair-987499390", "user_data": "}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:39.255775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] validate_networks() for [('ad62b422-f6a9-44d6-866f-37a78f2fcbac', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:28:39.625651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:28:39.626078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:28:39.626586 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:28:39.626999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:28:39.627413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:28:39.636414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:39.636816 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:39.637255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:39.637982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:39.638673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:39.640168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:39.658306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:28:39.662287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:28:39.673451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:28:39.675892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:28:39.724186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e7975c6e-c55b-406e-be45-19d686e6dbe6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590520 Oct 17 10:28:39.724835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 235/445] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:28:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 10:28:39.737334 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0d61fb9a-9356-4759-8e87-097651ac593a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:39.738075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0d61fb9a-9356-4759-8e87-097651ac593a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:39.793972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0d61fb9a-9356-4759-8e87-097651ac593a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:39.801530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0d61fb9a-9356-4759-8e87-097651ac593a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1241 microversion: 2.1 time: 0.069214 Oct 17 10:28:39.802111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 211/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:39 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:40.824166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:40.824773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:40.832035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:40.832516 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:40.832994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:40.833631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:40.834081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:40.834539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:40.898238 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:40.906188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-79a7713a-fda3-45e3-aba0-84e18c8e9d50 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1293 microversion: 2.1 time: 0.086396 Oct 17 10:28:40.906776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 236/447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:40 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:41.929375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:41.930221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:41.934081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:41.938830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:41.939318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:41.939752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:41.940485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:41.940945 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:41.941368 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:42.036996 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:42.044702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-60425d28-42d2-46fe-8ceb-bfdbbb35eeba tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1299 microversion: 2.1 time: 0.119554 Oct 17 10:28:42.045442 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 212/448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:41 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:43.067278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:43.068292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:43.075012 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:43.075500 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:43.075944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:43.077491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:43.077616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:43.078011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:43.122660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aad574-c9a9-4a6e-8210-38ae14243987", "tag": "4fcf66fa-6ad5-46ee-98fa-e103523d2a0f"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:43.136229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:43.137261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:43.137996 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:43.150590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] Creating event network-changed:4fcf66fa-6ad5-46ee-98fa-e103523d2a0f for instance 51aad574-c9a9-4a6e-8210-38ae14243987 on hv-cinder-86020 Oct 17 10:28:43.156295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-b8e90c72-d78b-4d6f-b1c7-a7a88b2642dc req-549e246c-d5b5-420b-815b-2385207168a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038560 Oct 17 10:28:43.156900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 213/449] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:28:43.225471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:43.233434 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-be9b2815-24c4-4db3-ac37-11ce190798d5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.170084 Oct 17 10:28:43.234014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 237/450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:43 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:44.256877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:44.257559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:44.264621 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:44.265198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:44.265631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:44.266316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:44.266791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:44.267210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:44.399743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:44.408330 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d99c7206-e56a-429d-b54d-144b72ec1f16 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.155692 Oct 17 10:28:44.408891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 214/451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:44 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:45.430638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:45.431243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:45.438209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:45.438774 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:45.439201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:45.439890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:45.440334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:45.440749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:45.570737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:45.578676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6725ea79-abfb-49f5-b1fa-2c71f63c0ae4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.151792 Oct 17 10:28:45.579235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 238/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:45 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:46.600755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:46.601359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:46.608485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:46.608954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:46.609381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:46.610060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:46.610530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:46.610947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:46.735474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:46.743045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-941c73f4-fcb0-4fb1-a234-e03f06d53c62 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.146059 Oct 17 10:28:46.743603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 215/453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:46 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:47.766513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:47.767123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:47.773381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:47.773859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:47.774292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:47.774999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:47.775453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:47.775875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:47.909154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:47.916699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-754b146c-0c49-4d78-8851-f4ee38315a10 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.154635 Oct 17 10:28:47.917255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 239/454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:47 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:48.939861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:48.940420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:48.946683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:48.947158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:48.947587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:48.948269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:48.948717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:48.949193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:49.083732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:49.091355 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-834f6104-6262-45a1-b28e-f45b7702ea67 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.156003 Oct 17 10:28:49.093082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 216/455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:48 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:49.700122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1161314926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1451062318", "security_groups": [{"name": "tempest-secgroup-smoke-352866282"}], "networks": [{"uuid": "d56795ad-30de-454e-bbb7-cab8a4532983"}], "block_device_mapping_v2": [{"uuid": "81f57b56-c1a8-4f12-8fe1-afe810945c12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:49.710929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:49.711599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:49.819847 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] validate_networks() for [('d56795ad-30de-454e-bbb7-cab8a4532983', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:28:50.116205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:50.116820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:50.119048 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:50.127955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:50.136225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:50.136684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:50.137428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:50.138920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:50.139111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:50.239191 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:28:50.240016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:28:50.241666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:28:50.242088 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:28:50.242664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:28:50.251637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:50.252118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:50.252764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:50.253497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:50.253951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:50.254425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:50.272911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Getting quotas for project 8ca835fdc95849cd8db1882ebb693cc3. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:28:50.278286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Getting quotas for user 75018aeecd6843c0a75bc95e8757fd8a and project 8ca835fdc95849cd8db1882ebb693cc3. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:28:50.340686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:28:50.343505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81f57b56-c1a8-4f12-8fe1-afe810945c12',volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:28:50.386602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:50.395916 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-412ce640-81da-4b14-9cf4-4881260e94ab tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.283931 Oct 17 10:28:50.406549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 217/456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:50 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:50.487936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-feb417ff-4141-4f54-903e-11d906fdf1dc tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791595 Oct 17 10:28:50.488581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 240/457] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:28:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:28:50.499813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3e1a3eab-08aa-4dbf-b36d-2e9844e6e95d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:50.500429 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3e1a3eab-08aa-4dbf-b36d-2e9844e6e95d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:50.557879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3e1a3eab-08aa-4dbf-b36d-2e9844e6e95d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:50.564942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3e1a3eab-08aa-4dbf-b36d-2e9844e6e95d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1089 microversion: 2.1 time: 0.069052 Oct 17 10:28:50.565499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 218/458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:50 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:28:50.905563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:50.911653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:50.912137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:50.912573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:50.976137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Going to try to stop instance {{(pid=118679) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 10:28:51.024111 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0bad6fb2-7de4-4b1a-83f9-0256aa909164 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action" status: 202 len: 0 microversion: 2.1 time: 0.122924 Oct 17 10:28:51.024703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 241/459] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:28:50 2022] POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:28:51.034213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:51.034869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:51.040878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.041708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.042243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.043117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.043597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.044278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.174657 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:51.182747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-84317939-57b3-4a98-83ae-7a8aca79b48f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.153510 Oct 17 10:28:51.183309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 219/460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:51 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:51.421900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:51.422615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:51.428696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.429175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.429605 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.430292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.430766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.431186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.562990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:51.570501 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-40deef2a-772a-4870-a46e-be012a030cf3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.153458 Oct 17 10:28:51.571054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 242/461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:51 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:51.588481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:51.589088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:51.595622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.596104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.596537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.597222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:51.597679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:51.598101 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:51.661317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:51.668941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-43464df3-9f14-4a8d-89de-b86b77d47991 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1187 microversion: 2.1 time: 0.084542 Oct 17 10:28:51.669510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 220/462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:51 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:52.207066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:52.207661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:52.213969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.214477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.214906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.215588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.216035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.216455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.352275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:52.360754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f100cc79-4436-4c55-b308-747600a419ee tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.157539 Oct 17 10:28:52.361306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 243/463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:52 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:52.593238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:52.593756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:52.600126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.600615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.601047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.601752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.602212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.602673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.693279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:52.693946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:52.700496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.701016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.701447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.702147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.702624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.703050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.777496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:52.786799 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f1be9857-4a95-4c46-9d0f-ea5e70a80a4a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1205 microversion: 2.1 time: 0.097329 Oct 17 10:28:52.787789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 244/464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:52 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1205 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:28:52.793685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aad574-c9a9-4a6e-8210-38ae14243987", "name": "network-vif-plugged", "status": "completed", "tag": "4fcf66fa-6ad5-46ee-98fa-e103523d2a0f"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:52.809581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:52.810058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:52.811451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:52.823717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] Creating event network-vif-plugged:4fcf66fa-6ad5-46ee-98fa-e103523d2a0f for instance 51aad574-c9a9-4a6e-8210-38ae14243987 on hv-cinder-86020 Oct 17 10:28:52.830566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-c17bff8b-c0a5-4d71-a366-efadd9fb379b req-0fbfa548-6830-4b20-bcf7-5f5ecc1b3b16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041362 Oct 17 10:28:52.831345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 245/465] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:52.871550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:52.879795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b4c422ef-e90b-4b30-ad17-c415e003f0be tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.290806 Oct 17 10:28:52.880361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 221/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:52 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:53.385471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:53.386411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:53.394792 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.395293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.395959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.396907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.397424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.397913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.537063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:53.546148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-72592a36-0875-4dd9-ad7c-90597dbae3a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.165229 Oct 17 10:28:53.546757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 246/467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:53 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:53.812981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:53.813591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:53.820714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.820822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.821259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.822131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.822877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.823263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.902409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:53.903131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:53.909850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.911252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.911868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.912585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:53.913043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:53.913491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:53.988958 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:53.997626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-321da069-941f-4a2e-bdb8-6e7434ec8209 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1272 microversion: 2.1 time: 0.188428 Oct 17 10:28:54.010812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 222/468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:53 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:54.065993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:54.081379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-581ea45f-df7d-4452-9dc5-3de54e3a72aa tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.182884 Oct 17 10:28:54.092743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 247/469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:53 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:28:54.568950 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:54.570284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:54.576964 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:54.577542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:54.577976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:54.578693 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:54.579146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:54.579690 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:54.629620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:54.640226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:54.640707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:54.641143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:54.651960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] Creating event network-changed:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:28:54.656836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-6d250e49-b141-41ef-b42c-09879c9787f6 req-f4953caf-3903-4b80-9607-997f41efd21a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030817 Oct 17 10:28:54.657440 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 248/470] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:28:54.758810 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:54.767144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-773fc214-33b4-42ca-bc0d-d6978309e7f2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.202052 Oct 17 10:28:54.767718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 223/471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:54 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:55.021555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:55.022155 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:55.028220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.028697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.029639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.030358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.030804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.031224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.111997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:55.113383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:55.120244 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.120828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.121348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.122179 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.122783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.124324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.179907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:55.188017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-88518878-b429-42a8-8a6a-d8f7ad84c3de tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1272 microversion: 2.1 time: 0.170680 Oct 17 10:28:55.188592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 249/472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:55 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:55.255001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:55.263331 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2e02bc50-5804-49d9-87ad-67c668a5d0c4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1367 microversion: 2.1 time: 0.155056 Oct 17 10:28:55.263331 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 224/473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:55 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:55.790399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:55.791013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:55.797658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.798139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.798606 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.799297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:55.799751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:55.800172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:55.804162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:55.941057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:55.949210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-820a4555-797f-432d-aede-e681ee593fcd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.162675 Oct 17 10:28:55.950362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 250/474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:55 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:56.210556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:56.211160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:56.217494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.217976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.218432 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.219115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.219565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.219985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.285332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:56.285948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:56.291697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.292169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.292598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.293280 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.293728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.294144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.358230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:56.365990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2cadea31-cfe6-4182-8769-f1d8db72c797 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.159256 Oct 17 10:28:56.366582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 225/475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:56 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:56.427413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:56.434983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f273af6d-ea85-463b-8c71-b9c1db76799c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1557 microversion: 2.1 time: 0.153501 Oct 17 10:28:56.436321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 251/476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:56 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:28:56.457714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:56.458206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:56.464022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.464499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.464928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.465609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.466058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.466628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.546189 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e9574ed8-2083-4bd5-a97a-dee6be661126 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092212 Oct 17 10:28:56.546847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 226/477] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:28:56 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:28:56.975026 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:56.975632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:56.984633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.985119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.985548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:56.986269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:56.986773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:56.987326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:57.126706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:57.135107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-967b1fe4-40c4-433b-8b3b-516e8d1dcbf5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.163988 Oct 17 10:28:57.135799 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 252/478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:56 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:57.389796 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:57.390428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:57.396338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:57.396820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:57.397250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:57.397940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:57.398497 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:57.398922 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:57.962535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:57.971340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-daee268c-acb5-4e4b-bf15-d15a1f7f5d1c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.585929 Oct 17 10:28:57.972005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 227/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:57 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:58.104981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aad574-c9a9-4a6e-8210-38ae14243987", "tag": "4fcf66fa-6ad5-46ee-98fa-e103523d2a0f"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:28:58.115028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:58.117004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:58.117589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:58.118082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:58.138117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] Creating event network-changed:4fcf66fa-6ad5-46ee-98fa-e103523d2a0f for instance 51aad574-c9a9-4a6e-8210-38ae14243987 on hv-cinder-86020 Oct 17 10:28:58.145218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-11943f84-58e5-4124-9b14-d45557884a84 req-12e60a04-0594-4ce4-8454-061c1d674cb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043909 Oct 17 10:28:58.146661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 253/480] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:28:58.159682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:58.160382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:58.162284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:28:58.182199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:58.182727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:58.183154 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:58.183892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:58.184352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:58.184768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:58.320237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:58.329409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5b9cf4ad-5f58-4026-898c-ee9d28e6af43 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.173524 Oct 17 10:28:58.330007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 228/481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:58 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:58.996417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:58.997109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:59.003529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:59.004008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:59.004435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:59.005123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:59.005597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:59.006017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:59.168386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:59.170893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f5ed731b-9d22-4e4c-a9ed-db7c9145c836 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.178955 Oct 17 10:28:59.171467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 254/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:58 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:28:59.353798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:28:59.355171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:28:59.362676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:59.363437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:59.364042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:59.365040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:28:59.365652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:28:59.366231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:28:59.588076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:28:59.597175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2f26c92f-949a-43dc-a735-5655553a854c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.247765 Oct 17 10:28:59.597795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 229/483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:28:59 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:00.193353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:00.193989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:00.200394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:00.201009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:00.201569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:00.202303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:00.202793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:00.203222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:00.261801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:00.288627 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:00.334317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:00.342203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-51144a51-83ba-48c8-9cc4-901d58306999 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.152484 Oct 17 10:29:00.342872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 255/484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:00 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:00.620066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:00.620698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:00.623482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:00.628831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:00.629318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:00.629748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:00.630526 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:00.630978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:00.631396 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:00.651085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:00.768672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:00.776970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b52b06f6-b31c-4c55-9886-6c3faea9d8ac tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.160741 Oct 17 10:29:00.777537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 230/485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:00 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:01.364922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:01.365534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:01.371945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:01.372425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:01.373378 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:01.374232 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:01.374713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:01.375139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:01.508328 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:01.515928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8518cca4-0311-4762-8b5d-a3b848b278d6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154841 Oct 17 10:29:01.516486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 256/486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:01 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:01.801352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:01.801964 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:01.808586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:01.809086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:01.809555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:01.810947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:01.811439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:01.811868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:01.939669 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:01.947806 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1df74db1-c0e5-4113-9c8f-377c37fe37dd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.150317 Oct 17 10:29:01.948366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 231/487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:01 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:02.538460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:02.539070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:02.545425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:02.545903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:02.546355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:02.547047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:02.547501 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:02.547923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:02.673958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:02.681532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2f4d9a40-9c26-4c92-80a5-33078ddef94a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.146870 Oct 17 10:29:02.682091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 257/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:02 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:02.970731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:02.971332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:02.977896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:02.978398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:02.979092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:02.979804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:02.980208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:02.980624 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:03.113044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:03.121413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-03e93567-c1a8-4e42-95ad-770ff4e5b219 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.154479 Oct 17 10:29:03.121991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 232/489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:02 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:03.704998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:03.705609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:03.712077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:03.712555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:03.712990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:03.713676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:03.714135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:03.714588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:03.845687 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:03.853268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2035b02f-10b0-4d5a-945d-fd3d82c14a0a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.152131 Oct 17 10:29:03.854095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 258/490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:03 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:04.145768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:04.146402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:04.152723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:04.153198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:04.153627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:04.154866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:04.155320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:04.155734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:04.286022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:04.294240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e47d90a4-a09b-452d-8d1b-5ecb0fa0944d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.152321 Oct 17 10:29:04.294966 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 233/491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:04 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:04.877095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:04.877665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:04.884312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:04.884787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:04.885214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:04.885901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:04.886371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:04.886795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:05.018922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:05.026736 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a1f463c4-9f7a-4a00-b4d3-bf7786504d38 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154365 Oct 17 10:29:05.027296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 259/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:04 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:05.318092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:05.318743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:05.325261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:05.326413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:05.326905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:05.327609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:05.328099 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:05.328527 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:05.455533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:05.463724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-868dc2ea-dcd0-4be2-ab31-b2d72ff88655 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.149491 Oct 17 10:29:05.464304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 234/493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:05 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:06.050638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:06.051243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:06.057505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:06.057978 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:06.058439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:06.059117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:06.059565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:06.059980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:06.193616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:06.202073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-670bd9d9-f8a6-4503-9088-8e82bd97adae tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.155035 Oct 17 10:29:06.202967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 260/494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:06 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:06.488430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:06.489208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:06.495730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:06.496258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:06.496680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:06.497373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:06.497840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:06.498269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:06.627266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:06.635443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-53b373c6-d7ba-4f38-9854-819e045492bf tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.150941 Oct 17 10:29:06.636018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 235/495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:06 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:07.224868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:07.225471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:07.232205 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:07.232676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:07.233105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:07.233786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:07.234234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:07.234689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:07.366262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:07.374441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-24736e4a-9dcb-47d1-b210-e9ad20574c52 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.153363 Oct 17 10:29:07.375011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 261/496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:07 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:07.658485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:07.659121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:07.665504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:07.665988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:07.666445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:07.667132 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:07.667584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:07.668003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:07.796607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:07.804637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2ffe2940-f61d-4a53-9e90-454275853019 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.150012 Oct 17 10:29:07.805199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 236/497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:07 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:08.398928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:08.399470 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:08.406628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:08.407115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:08.407549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:08.408241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:08.408692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:08.409139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:08.541051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:08.549097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e398c37e-c525-4a6b-8300-dbb4710a88b3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154073 Oct 17 10:29:08.549652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 262/498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:08 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:08.829157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:08.829744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:08.836142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:08.836620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:08.837050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:08.837735 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:08.838190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:08.838636 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:08.968047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:08.976120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7323edd3-7909-40c9-ab3b-f268f12740a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.151477 Oct 17 10:29:08.976683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 237/499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:08 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:09.571583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:09.572222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:09.579365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:09.579847 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:09.580286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:09.580973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:09.581424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:09.581840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:09.722197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:09.730422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3934c24e-3b16-4cc8-b684-fdb87d31968c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.162587 Oct 17 10:29:09.730999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 263/500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:09 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:10.000472 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:10.001061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:10.013036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:10.014731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:10.015242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:10.015995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:10.016450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:10.016877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:10.156065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:10.164251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cdf92c5b-ec30-4618-9bbe-49acee305bf2 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.167602 Oct 17 10:29:10.164816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 238/501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:09 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:10.754630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:10.755307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:10.762864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:10.763452 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:10.763833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:10.764621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:10.765080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:10.765510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:10.927973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:10.937314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dcd320af-5a2d-4916-b940-611244724f32 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.187119 Oct 17 10:29:10.946693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 264/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:10 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:11.187748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:11.188431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:11.195033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:11.195548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:11.195988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:11.196683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:11.197168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:11.197568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:11.327523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:11.335784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ac105f80-04b1-44c4-9a3a-3758e4243e28 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.152413 Oct 17 10:29:11.336350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 239/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:11 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:11.960804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:11.961418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:11.969003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:11.969491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:11.969921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:11.970651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:11.971104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:11.971524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:11.971862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-708567147", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:12.024640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] validate_networks() for None {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:29:12.106378 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:12.114236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dc3a144c-1319-4984-a9fe-130ca91669cd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.157149 Oct 17 10:29:12.114833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 265/504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:11 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:12.298591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:29:12.299148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:29:12.299631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:29:12.300040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:29:12.300456 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:29:12.309191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:12.309673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:12.310106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:12.310942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:12.311395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:12.311820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:12.329323 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Getting quotas for project 42e2bfadfd7546eda906a580a16c5a59. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:29:12.333282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Getting quotas for user 800ab212b7cb45a59949f2b142faeeb7 and project 42e2bfadfd7546eda906a580a16c5a59. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:29:12.345183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:29:12.347476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:29:12.360776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:12.361469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:12.367490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:12.368045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:12.368544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:12.369301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:12.369754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:12.370170 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:12.395809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2e8d2392-6df2-4a2c-a7bb-c094a64942f8 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428689 Oct 17 10:29:12.396466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 240/505] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 10:29:12.408452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-928a902c-e458-4ba0-90ae-2b5d632d930c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:12.409191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-928a902c-e458-4ba0-90ae-2b5d632d930c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:12.463421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-928a902c-e458-4ba0-90ae-2b5d632d930c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:12.471368 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-928a902c-e458-4ba0-90ae-2b5d632d930c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1214 microversion: 2.1 time: 0.067881 Oct 17 10:29:12.472258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 241/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:12 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:12.519899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:12.528053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6c03577a-2906-4320-9174-3c18ced8127e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.171521 Oct 17 10:29:12.528695 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 266/507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:12 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:13.137777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:13.138412 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:13.145036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.145522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.145953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.146665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.147118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.147540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.277925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:13.286270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6fba4344-8067-4f89-a1b0-829e2de3c51c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.152404 Oct 17 10:29:13.286870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 242/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:13 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:13.498544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:13.499540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:13.508238 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.509110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.509900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.511194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.512036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.512819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.532948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:13.551183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:13.551794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:13.557737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.558232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.558705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.559408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:13.559866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:13.560291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:13.574412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:13.583120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-51a947ba-e350-4238-851a-475fdc882db4 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.091861 Oct 17 10:29:13.583698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 267/509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:13 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:13.689067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:13.697215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2d33b6c0-7fd2-4cef-9456-1a436436a4d5 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.149797 Oct 17 10:29:13.697778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 243/510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:13 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:14.309013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:14.309649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:14.316318 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.316796 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.317229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.317917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.318392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.318821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.449771 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:14.457661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-48cd8b99-1d16-4000-a608-12476e8e018d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.152536 Oct 17 10:29:14.458227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 268/511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:14 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:14.606470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:14.607104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:14.614670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.615148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.615574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.616257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.616708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.617127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.678696 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:14.686205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-033a9ec1-5af4-40a7-a370-4d33aac85655 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.083878 Oct 17 10:29:14.686794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 244/512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:14 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:14.721376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:14.722112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:14.728528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.729264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.729699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.730422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:14.730879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:14.731304 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:14.860499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:14.868555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2e40b4c3-8aa6-4592-8bce-a33d0b99dc25 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.151827 Oct 17 10:29:14.869114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 269/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:14 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:15.481147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:15.481753 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:15.488634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.489109 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.489540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:15.490215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.490691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.491112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:15.627448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:15.635118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-deecab01-cee8-4eb1-aee4-d69fce9a1acf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.158055 Oct 17 10:29:15.635680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 245/514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:15 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:15.708311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:15.708920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:15.715166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.715647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.716094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:15.717321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.717804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.718225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:15.778408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:15.786590 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b6cd5f7f-d86d-4883-a049-3f8355eeb347 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.082013 Oct 17 10:29:15.787157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 270/515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:15 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:15.892892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:15.893500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:15.899498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.900065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.900505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:15.901191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:15.901649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:15.902077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:16.027730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:16.036509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-05bc0f18-6957-48af-a6d8-64b9ecab4c84 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.148231 Oct 17 10:29:16.037078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 246/516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:15 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:16.658416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:16.659028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:16.664913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:16.665395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:16.665826 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:16.666544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:16.666999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:16.667420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:16.798999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:16.806612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1f0d3938-1b02-4cde-9d09-d697c1ccddef tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.152212 Oct 17 10:29:16.807175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 271/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:16 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:16.808728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:16.809338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:16.816366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:16.816848 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:16.817286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:16.817974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:16.818463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:16.818888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:16.880647 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:16.888289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dc41e935-5793-48cd-bc1b-439921cb826c tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.083411 Oct 17 10:29:16.888906 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 247/518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:16 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:17.059473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:17.060080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:17.066036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.066553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.066990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.067685 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.068140 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.068563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.196045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:17.204243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-31be1b42-e15b-4065-a142-3c2148032d93 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.148686 Oct 17 10:29:17.204814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 272/519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:17 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:17.831364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:17.832028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:17.838420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.838909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.839343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.840030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.840485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.840907 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.911071 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:17.911672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:17.917983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.918509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.918932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.919616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:17.920392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:17.921025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:17.975466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:17.979815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:17.982124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:17.985453 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8b5665c9-c54e-43e0-94d5-f39247c50e84 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.158129 Oct 17 10:29:17.986033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 248/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:17 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:17.990911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fdcadd32-0e2a-4eeb-9489-2e67e6b4ece3 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.083596 Oct 17 10:29:17.991464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 273/521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:17 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:18.227968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:18.228498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:18.235847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:18.236320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:18.236748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:18.237427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:18.237882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:18.238296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:18.366446 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:18.374560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b94357e4-3a60-4d05-aa16-8ea8db643bd0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.150524 Oct 17 10:29:18.375118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 249/522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:18 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:19.008625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:19.009233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:19.014201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:19.015617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:19.016593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.017075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.017506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.018196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.018671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.019091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.021895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.022401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.022837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.023649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.024102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.024525 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.090204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:19.098386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6e630c56-b6ed-44fb-8da4-a6f69bb61595 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.087866 Oct 17 10:29:19.099298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 250/523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:19 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:19.167384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:19.175233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fd93faa1-ed39-4d3c-93a0-b577e8ade36d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.170465 Oct 17 10:29:19.175799 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 274/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:19 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:19.397190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:19.397820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:19.403671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.404146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.404573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.405324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:19.405716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:19.406146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:19.536602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:19.550248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6aa56002-8c2b-4a55-9135-452740de0ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.156924 Oct 17 10:29:19.550861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 251/525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:19 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:20.122435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:20.123047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:20.130300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.130860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.131349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.132029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.132475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.132892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.196986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:20.198925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:20.199778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:20.205431 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1de4804d-0d66-4fbd-bdf2-c7e3e2402e47 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.086985 Oct 17 10:29:20.206008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 275/526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:20 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:20.206907 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.207400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.207839 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.208536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.208994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.209418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.340985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:20.348800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f3430d71-57f6-440a-a058-606c4c097d88 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.153905 Oct 17 10:29:20.349379 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 252/527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:20 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:20.573923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:20.574563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:20.581729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.582224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.582733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.583475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:20.583970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:20.584398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:20.709904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:20.718207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-eb8b6a1d-b09f-47bf-9534-b13dc52888e4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.148159 Oct 17 10:29:20.718834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 276/528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:20 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:21.228246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:21.229116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:21.236498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.236965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.237394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.238074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.238557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.238976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.302615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:21.310093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-902db951-95a8-4b7c-8e03-8fd429311bab tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.085640 Oct 17 10:29:21.310742 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 253/529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:21 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:21.372314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:21.372927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:21.379444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.379928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.380362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.381059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.381517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.381942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.514025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:21.522287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3ecbbeaf-b527-4346-b40c-a4dc359f8778 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.153798 Oct 17 10:29:21.522874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 277/530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:21 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:21.740918 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:21.741522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:21.747491 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.747973 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.748407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.749752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:21.750528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:21.750967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:21.878290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:21.886482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-927f6983-c35a-4dac-84f9-68eeb2c4219b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.149366 Oct 17 10:29:21.887044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 254/531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:21 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:22.333158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:22.333693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:22.339676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.340164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.340600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:22.341288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.341750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.342172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:22.401481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:22.409637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7629cdc6-c3b0-45a3-8543-cff54d67f1ea tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.080427 Oct 17 10:29:22.410201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 278/532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:22 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:22.545258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:22.545873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:22.548261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:22.548971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=8 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:22.555093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.555883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.556077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:22.556911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.557420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.557849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:22.687251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:22.695167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d69cce15-bc32-4963-8027-08b33c962ac4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.153745 Oct 17 10:29:22.699063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 255/533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:22 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:22.909169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:22.909702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:22.915943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.916429 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.916870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:22.917560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:22.918025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:22.918487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:23.046272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:23.054400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8a710036-e646-4bd4-9572-7fb2658ac928 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.149394 Oct 17 10:29:23.054959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 279/534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:22 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:23.432545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:23.433155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:23.439864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:23.440358 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:23.440799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:23.441535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:23.441997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:23.442460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:23.504902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:23.512651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-757d65a7-50da-4754-b69f-86fe05332783 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.083945 Oct 17 10:29:23.513216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 256/535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:23 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:23.719049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:23.719601 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:23.725982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:23.726514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:23.726984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:23.727679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:23.728163 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:23.728844 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:23.860518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:23.868495 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-624dd8e5-391c-4ce6-8e44-bb466322c703 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154132 Oct 17 10:29:23.869067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 280/536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:23 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:24.078529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:24.079147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:24.085616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.086115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.086592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:24.087302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.087764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.088194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:24.219407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:24.227776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-51cc3e5e-d98e-48de-9f90-a313262e1f6d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.153815 Oct 17 10:29:24.228349 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 257/537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:24 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:24.535615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:24.536299 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:24.542347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.542854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.543291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:24.543981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.544438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.544897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:24.604185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:24.611956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-87054057-6274-486a-828c-d79487012835 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1218 microversion: 2.1 time: 0.080294 Oct 17 10:29:24.612521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 281/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:24 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:24.891673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:24.892180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:24.898174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.898699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.899139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:24.899837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:24.900297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:24.900727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.028812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:25.036617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-38e6cf11-db46-401a-82d5-6134d0e9aae6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.149114 Oct 17 10:29:25.037190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 258/539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:24 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:25.251202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:25.251822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:25.258236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.258755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.259199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.259886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.260346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.260772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.401819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:25.411016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0757212c-68b3-4f08-8a91-e49481453c5b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1701 microversion: 2.1 time: 0.163615 Oct 17 10:29:25.411580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 282/540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:25 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:25.438427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:25.446909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.447390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.447822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.526156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Going to try to start instance {{(pid=118680) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 10:29:25.579513 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-457b536b-6ab2-4e3a-8667-e26864506e6f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action" status: 202 len: 0 microversion: 2.1 time: 0.146300 Oct 17 10:29:25.580461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 259/541] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:29:25 2022] POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:29:25.588602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:25.589204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:25.595928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.596407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.596837 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.597525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.597974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.598424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.635026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:25.635726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:25.642885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.643395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.643824 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.644535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:25.645001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:25.645430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:25.712786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:25.721247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8e442cbe-34d6-482a-b618-86d52afecae5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1210 microversion: 2.1 time: 0.090374 Oct 17 10:29:25.721837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 260/542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:25 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:25.745662 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:25.756034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1cf8ba00-b92b-4c38-8a37-a5b91f6e157c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1710 microversion: 2.1 time: 0.171287 Oct 17 10:29:25.756626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 283/543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:25 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:26.060246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:26.060850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:26.067258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.067765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.068206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.068898 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.069352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.069775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.206008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:26.213688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-22f1ea2f-e615-4c17-b40d-e7d8c990c0f0 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.157390 Oct 17 10:29:26.214252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 261/544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:26 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:26.746767 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:26.747380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:26.754185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.754697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.755130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.755814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.756265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.756689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.760568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:26.778724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:26.779539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:26.786294 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.786871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.787336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.788035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:26.788494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:26.788923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:26.818563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:26.827768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dfcb0b23-20bf-47a2-a299-4e9c295d99a1 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1266 microversion: 2.1 time: 0.084192 Oct 17 10:29:26.828817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 284/545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:26 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:26.916129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:26.924445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3d34d99c-e8ac-4a33-af36-b738dfd4830e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1710 microversion: 2.1 time: 0.149725 Oct 17 10:29:26.925015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 262/546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:26 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:27.297528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:27.298138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:27.304422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.304914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.305347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:27.306052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.306535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.306963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:27.449852 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:27.457906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ebd2eaec-be47-4798-84d4-3909a56ff1e3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.165118 Oct 17 10:29:27.458553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 285/547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:27 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:27.850971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:27.851622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:27.858637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.859509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.860039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:27.860745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.861211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.861643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:27.931100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:27.939324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2497a400-f8c3-44c1-8495-283166022b98 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1272 microversion: 2.1 time: 0.092104 Oct 17 10:29:27.941088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 263/548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:27 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:27.948420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:27.949248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:27.960560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.961211 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.961793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:27.962814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:27.963298 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:27.963820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:28.098253 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:28.106909 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a4d9f149-7c06-49bf-a4e3-b597c70625d8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1710 microversion: 2.1 time: 0.162740 Oct 17 10:29:28.107483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 286/549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:27 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:28.481346 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:28.482608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:28.484738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:28.490033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:28.490870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:28.491200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:28.491963 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:28.492492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:28.492986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:28.511506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:28.689013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:28.696818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-39d74eb3-3c89-4543-8a99-0458e7b04c04 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.219688 Oct 17 10:29:28.697388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 264/550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:28 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:28.964938 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:28.966126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:28.975186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:28.975674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:28.976104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:28.976923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:28.977229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:28.977647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.081937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6984b3-a0d2-43ca-ac12-85a249de5f2e", "tag": "fbb656fa-0f51-459f-a3b5-85e1abb478f3"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:29.094658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:29.095431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:29.096050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.112913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] Creating event network-changed:fbb656fa-0f51-459f-a3b5-85e1abb478f3 for instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e on hv-cinder-86020 Oct 17 10:29:29.119126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-a3c9bb44-3acd-49d6-91d5-0675c153e327 req-b03044eb-ae33-406d-8a1b-6cd07d24beca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Oct 17 10:29:29.120137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 265/551] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:29:29.132891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:29.133826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:29.140160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:29.140510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:29.140676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:29.141072 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.141781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:29.142386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:29.142821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.148870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e70d7767-fcdc-4256-9d35-b1e8678b4506 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.187754 Oct 17 10:29:29.149440 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 287/552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:28 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:29.344264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:29.352617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3005f9d6-56a4-4cbf-8c41-1df711032d02 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1714 microversion: 2.1 time: 0.224176 Oct 17 10:29:29.353191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 266/553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:29 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1714 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:29.721237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:29.721758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:29.723810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=70 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:29.729453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:29.729937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:29.730435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.731135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:29.731587 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:29.732010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:29.864241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:29.871802 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-59d76788-dfe9-46bd-8b37-c03bf7363825 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154660 Oct 17 10:29:29.872364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 288/554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:29 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:30.174480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:30.175080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:30.181910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:30.182414 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:30.182874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:30.183557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:30.184009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:30.184426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:30.313408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:30.321032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1aa702cd-193b-49d4-af9b-def31ac1ba89 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.150965 Oct 17 10:29:30.321603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 267/555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:30 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:30.896372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:30.896973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:30.903374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:30.903850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:30.904275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:30.904952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:30.905394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:30.905808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:31.034879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:31.042583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cef3db50-1d0b-402f-89a4-0a3dd8690793 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.150671 Oct 17 10:29:31.043147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 289/556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:30 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:31.401024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:31.401705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:31.408685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:31.409193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:31.409698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:31.410499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:31.410954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:31.411372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:31.515108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "name": "network-vif-plugged", "status": "completed", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:31.526038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:31.526562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:31.526993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:31.539944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] Creating event network-vif-plugged:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:29:31.545180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-0bf66590-d557-4985-862c-1f688e1d79a1 req-861e4582-af7a-41a2-bf47-a9cfc4e94119 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Oct 17 10:29:31.546152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 290/557] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:29:31.546632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:31.555458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-47d2bbd0-3984-4bbc-aaf3-5fe4a1c7fc40 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.158615 Oct 17 10:29:31.556128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 268/558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:31 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:32.066718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:32.067406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:32.073573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:32.074050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:32.074509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:32.075212 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:32.075664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:32.076081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:32.208102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:32.215727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-badc45c9-5b98-4bfc-b14e-3f9290e26827 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.154011 Oct 17 10:29:32.216301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 291/559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:32 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:32.580011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:32.580632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:32.587440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:32.587928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:32.588371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:32.589069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:32.589527 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:32.589954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:32.780250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:32.788203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-876ea33e-7c7b-4662-9daa-376bcdb81e38 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.212605 Oct 17 10:29:32.788793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 269/560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:32 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:33.240118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:33.240715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:33.247080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:33.247561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:33.247995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:33.248681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:33.249132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:33.249553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:33.380218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:33.387978 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1a5d157c-be09-483c-8692-8ad4ef4a9009 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.151783 Oct 17 10:29:33.388551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 292/561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:33 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:33.810661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:33.811300 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:33.817981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:33.818485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:33.818921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:33.819605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:33.820056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:33.820477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:33.947896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:33.956158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7e6b0827-8046-44b7-917d-8700ebed76cd tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.149270 Oct 17 10:29:33.956729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 270/562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:33 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:34.410582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:34.411203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:34.417539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:34.418019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:34.418490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:34.419184 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:34.419646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:34.420103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:34.558618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:34.567147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1095ecbd-ba87-4e6f-9070-1e04f6965a82 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1260 microversion: 2.1 time: 0.160490 Oct 17 10:29:34.567728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 293/563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:34 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:34.979293 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:34.979905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:34.986614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:34.987127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:34.987559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:34.988247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:34.988703 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:34.989155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:35.115055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:35.122588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4d320388-e0c7-469f-b90f-86d930650132 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.147399 Oct 17 10:29:35.123155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 271/564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:34 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:35.590995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:35.591619 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:35.598641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:35.599126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:35.599559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:35.600244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:35.600694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:35.601119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:35.893928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:35.901632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2ee13b72-df21-4aa9-92e7-93cb96065d94 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1444 microversion: 2.1 time: 0.314496 Oct 17 10:29:35.902204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 294/565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:35 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1444 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:35.925880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:35.926534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:35.932605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:35.933094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:35.933527 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:35.934221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:35.934709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:35.935131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:35.989352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6984b3-a0d2-43ca-ac12-85a249de5f2e", "name": "network-vif-plugged", "status": "completed", "tag": "fbb656fa-0f51-459f-a3b5-85e1abb478f3"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:36.006758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:36.007347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:36.007850 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:36.020021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] Creating event network-vif-plugged:fbb656fa-0f51-459f-a3b5-85e1abb478f3 for instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e on hv-cinder-86020 Oct 17 10:29:36.025274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-6cec6778-9339-4fd7-802d-0a7a10d3c66e req-5c9c02df-497b-4fe6-9364-34faa8d52872 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039744 Oct 17 10:29:36.026006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 295/566] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:29:36.092428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:36.101439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2ebbbf8e-fd5b-4c0e-a8bc-25b2f48e205a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1444 microversion: 2.1 time: 0.179952 Oct 17 10:29:36.102086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 272/567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:35 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:36.147393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:36.148179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:36.154618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:36.155101 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:36.155525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:36.157365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:36.159730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:36.160268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:36.298121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:36.307081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-04ad3145-1d72-44e9-a422-9e4fd96cbb08 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.163988 Oct 17 10:29:36.307667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 296/568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:36 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:37.330606 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:37.331216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:37.337657 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:37.338134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:37.338597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:37.339281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:37.339732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:37.340152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:37.473181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:37.480986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1054ef29-e4ad-4294-95dd-18d01aa33eff tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.154757 Oct 17 10:29:37.481551 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 273/569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:37 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:38.068229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:38.078116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:38.079213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:38.079769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:38.091502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] Creating event network-changed:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:29:38.096737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-62d1d22b-a8d5-4dba-aa88-625c29bd4f8f req-f7d9d993-d9e6-42c0-807d-d30a06606daf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032343 Oct 17 10:29:38.097533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 297/570] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:29:38.505051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:38.505786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:38.512195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:38.512679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:38.513115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:38.513811 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:38.514276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:38.514727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:38.796875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:38.807022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-98114094-eb36-442f-9ff5-c4419e7643d2 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.305799 Oct 17 10:29:38.807737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 274/571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:38 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:39.831561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:39.832256 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:39.838315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:39.838823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:39.839255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:39.839940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:39.840391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:39.840812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:39.969610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:39.977271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4c261d8f-f746-44f3-a54a-cf178a465ff5 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.150672 Oct 17 10:29:39.977835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 298/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:39 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:41.000481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:41.001688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:41.008159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:41.008645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:41.009072 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:41.009761 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:41.010212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:41.010661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:41.145879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:41.153699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4cfbc5aa-fb56-47e9-b342-777767c66288 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1314 microversion: 2.1 time: 0.157685 Oct 17 10:29:41.154261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 275/573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:40 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:42.176867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:42.177477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:42.183997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.184478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.184908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.185596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.186046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.186503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.319027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:42.326815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-01d1d408-5bed-45db-8eee-abd41effd317 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1463 microversion: 2.1 time: 0.153701 Oct 17 10:29:42.327384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 299/574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:42 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:42.373819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:42.374373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:42.380796 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.381282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.381724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.382444 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.382910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.383363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.408254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:29:42.481695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-76a179de-544f-4843-ae1a-f925f7752ad9 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 204 len: 0 microversion: 2.1 time: 0.111619 Oct 17 10:29:42.482282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 276/575] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:29:42 2022] DELETE /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:29:42.491202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:42.491814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:42.497577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.498051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.498522 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.499202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:42.499653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:42.500680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:42.627561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:42.635105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8716383e-3e65-480c-a0e0-4a65e75a0f76 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1469 microversion: 2.1 time: 0.147796 Oct 17 10:29:42.635666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 300/576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:42 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:43.659341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:43.660027 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:43.666528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:43.667005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:43.667435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:43.668114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:43.668560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:43.668976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:43.795597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:43.803804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-80d33029-6229-4b6c-bbe4-4a6f546f2a49 tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1469 microversion: 2.1 time: 0.149255 Oct 17 10:29:43.804379 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 277/577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:43 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:29:44.826796 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:44.827428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:44.835258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:44.835736 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:44.836165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:44.836864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:44.837313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:44.837728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:44.973835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800ab212b7cb45a59949f2b142faeeb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e2bfadfd7546eda906a580a16c5a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:29:44.981916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-15fc40e6-dc53-4713-b812-ac765ccd99bb tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 200 len: 1469 microversion: 2.1 time: 0.159018 Oct 17 10:29:44.994365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 301/578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:44 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:29:45.076750 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6984b3-a0d2-43ca-ac12-85a249de5f2e", "name": "network-vif-deleted", "tag": "fbb656fa-0f51-459f-a3b5-85e1abb478f3"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:45.088340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:45.088805 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:45.089280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:45.107063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] Creating event network-vif-deleted:fbb656fa-0f51-459f-a3b5-85e1abb478f3 for instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e on hv-cinder-86020 Oct 17 10:29:45.113254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-2836b58a-8544-4193-91b4-f5afcb1c3e1e req-c7ebb30a-8df2-44d1-ad63-484c0953694d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039736 Oct 17 10:29:45.113716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 278/579] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:29:46.005406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:46.006025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] [instance: eb6984b3-a0d2-43ca-ac12-85a249de5f2e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:46.012910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:46.013395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:46.013866 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:46.014568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:46.015022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:46.015449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:46.029219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] HTTP exception thrown: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Request method failure captured: Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e HTTP/1.1 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS52KzVlFlBq_9BSVWHdgzDogB2hTbdst5sUCop-72MDmWoa6hTNhKJuKq6lHBgpzzgsOXlCB7CQQB3e5WQao-hrE-65YqGjYsvShivOVbmQEoH_slaikbY34sO3z25RhiOIarJB6BESVDpftozGBmvERtLx9oe5AC0zGOmht_0-vVQ Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 42e2bfadfd7546eda906a580a16c5a59 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesNegativeTest-1571491013 Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:29:46.030896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e2bfadfd7546eda906a580a16c5a59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e2bfadfd7546eda906a580a16c5a59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e2bfadfd7546eda906a580a16c5a59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e2bfadfd7546eda906a580a16c5a59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesNegativeTest-1571491013 Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 42e2bfadfd7546eda906a580a16c5a59 Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesNegativeTest-1571491013 Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesNegativeTest-1571491013-project Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 800ab212b7cb45a59949f2b142faeeb7 Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesNegativeTest-1571491013-project Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. Oct 17 10:29:46.033175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'eb6984b3-a0d2-43ca-ac12-85a249de5f2e'} Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:29:46.034197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. Oct 17 10:29:46.035677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:29:46.036988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] Returning 404 to user: Instance eb6984b3-a0d2-43ca-ac12-85a249de5f2e could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:29:46.036988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-af36b192-dfde-4d33-ab61-ee280c4596be tempest-VolumesNegativeTest-1571491013 tempest-VolumesNegativeTest-1571491013-project] 10.222.0.16 "GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e" status: 404 len: 111 microversion: 2.1 time: 0.031409 Oct 17 10:29:46.036988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 302/580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:46 2022] GET /compute/v2.1/servers/eb6984b3-a0d2-43ca-ac12-85a249de5f2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:29:59.765093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:29:59.768640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:59.770822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:59.771467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:59.777768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:59.778267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:59.778722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:59.779401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:59.779849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:59.780265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:59.853053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7fc6e96e-ecc8-4505-b53c-b6281322fb3e tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action" status: 202 len: 0 microversion: 2.1 time: 0.092000 Oct 17 10:29:59.857070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 279/581] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:29:59 2022] POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:29:59.862646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:29:59.863292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:29:59.866247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=29 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:59.867000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=96 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:29:59.872814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:59.873296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:59.873728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:29:59.874461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:29:59.874994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:29:59.875952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:00.024729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:00.032926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7984d48a-3c92-4ea8-851e-8cdfce1ac34a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1750 microversion: 2.1 time: 0.174412 Oct 17 10:30:00.033494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 303/582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:29:59 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:01.057454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:01.058155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:01.065138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:01.065626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:01.066068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:01.066797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:01.067258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:01.067693 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:01.213023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:01.221319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-29c9cac7-f54a-449d-b0ab-9c7c57ac1c1a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.168524 Oct 17 10:30:01.221954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 280/583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:01 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:02.244785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:02.245400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:02.251870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:02.252348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:02.252789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:02.253483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:02.253946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:02.254406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:02.392983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:02.401051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-17627be3-30f6-4713-97bb-6c572f403030 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.160160 Oct 17 10:30:02.401615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 304/584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:02 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:03.426764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:03.427374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:03.434201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:03.434758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:03.435204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:03.435901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:03.436366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:03.436785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:03.582923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:03.590825 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-863ff379-e956-43f7-8b08-e3f4bcd0a0ab tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.168215 Oct 17 10:30:03.591387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 281/585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:03 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:04.614676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:04.615286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:04.621634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:04.622123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:04.622592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:04.623288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:04.623736 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:04.624160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:04.768511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:04.777428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-589e6960-0e31-44a5-9f48-f9f1cc99f530 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.166577 Oct 17 10:30:04.778013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 305/586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:04 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:05.501141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "902df21d-34b0-429f-954f-fcb18fb664d8"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:05.503597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:05.510257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:05.510781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:05.511215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:05.511897 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:05.512352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:05.512780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:05.781803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6b4f6735-158b-4821-8875-337e1053b2e6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443057 Oct 17 10:30:05.782813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 282/587] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:30:05 2022] POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:05.802473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:05.803834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:05.810208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:05.810835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:05.811264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:05.811951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:05.812396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:05.812811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:05.954640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:05.963673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e687f573-123e-4c21-b32c-550716a4379c tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.166559 Oct 17 10:30:05.964234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 306/588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:05 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:06.987415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:06.988068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:06.994676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:06.995155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:06.995585 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:06.996270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:06.996721 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:06.997143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:07.146295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:07.154469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ae0f57b0-4ce6-44bf-9eca-91397fa5e109 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.171270 Oct 17 10:30:07.155034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 283/589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:06 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:08.177015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:08.177709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:08.184034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:08.184515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:08.184947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:08.185626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:08.186075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:08.186528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:08.330556 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:08.339665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-66999fcb-9fd2-4868-af9e-3d9873bf0ac6 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.166537 Oct 17 10:30:08.340222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 307/590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:08 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:09.363582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:09.364191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:09.371528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:09.372011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:09.372445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:09.373137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:09.373590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:09.374015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:09.517397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:09.526275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-209220aa-8cdc-4b24-9593-bd276a7ddb21 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.166596 Oct 17 10:30:09.526940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 284/591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:09 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:10.549075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:10.549686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:10.556404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:10.556885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:10.557315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:10.557997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:10.558498 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:10.558921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:10.701052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:10.709768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a58217e0-a07e-4591-81ed-44995ab715f1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.164615 Oct 17 10:30:10.710343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 308/592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:10 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:11.790454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:11.791058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:11.797632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:11.798112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:11.798579 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:11.799269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:11.799722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:11.800151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:11.948620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:11.956844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2f83fa45-6576-4529-b12e-939c382a9d68 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.170880 Oct 17 10:30:11.957413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 285/593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:11 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:12.981481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:12.982097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:12.988854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:12.989342 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:12.989784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:12.990538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:12.991720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:12.992159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:13.143505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:13.151906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c9291bce-38b4-40cf-9f35-2948dee32994 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.174503 Oct 17 10:30:13.152474 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 309/594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:12 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:14.176288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:14.177056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:14.183631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.184096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.184540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.185235 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.185695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.186126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.343113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:14.352740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cdf9374d-10ee-449d-89cf-44cc8901ba10 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.179913 Oct 17 10:30:14.353240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 286/595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:14 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:14.396067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:14.399275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:14.405664 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.406154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.406624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.407514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.407976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.408410 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.431215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'flavor' on Instance uuid 11c512a4-6f18-43c9-81e9-ff733da8bbb3 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:14.602507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3458bc9-0df2-4ca5-8e08-e770ab89e387 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/action" status: 200 len: 32 microversion: 2.1 time: 0.210178 Oct 17 10:30:14.603118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 310/596] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:30:14 2022] POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:30:14.613047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:14.613670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:14.620460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.620941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.621373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.622293 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:14.622772 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:14.623376 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:14.850523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:14.859309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cdaedf44-22f9-44d3-ab1d-c3d4d3adc215 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.249959 Oct 17 10:30:14.859917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 287/597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:14 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:15.377336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:15.378028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:15.384303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:15.384774 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:15.385201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:15.385879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:15.386348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:15.386779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:15.530608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:15.538738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-42274f4d-d81b-42bd-9c91-be72ec86b026 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.165758 Oct 17 10:30:15.540425 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 311/598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:15 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:15.882724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:15.883943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:15.890342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:15.890827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:15.891259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:15.891937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:15.892387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:15.892805 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:16.024431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:16.032577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3d16566d-e90f-4aa4-972f-98b8a4e76168 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.153727 Oct 17 10:30:16.033144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 288/599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:15 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:16.563394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:16.564003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:16.570985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:16.571530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:16.571830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:16.572520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:16.572977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:16.573400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:16.711947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:16.720786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4459f331-cb5d-4ed3-a99f-5fb6672454c2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1755 microversion: 2.1 time: 0.161286 Oct 17 10:30:16.721363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 312/600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:16 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:17.055312 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:17.055917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:17.062313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:17.062827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:17.063263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:17.063947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:17.064404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:17.064827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:17.194104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:17.202929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a5ac6f50-10fb-4cba-9835-7c7118d2da35 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.151962 Oct 17 10:30:17.203494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 289/601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:17 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:17.744935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:17.745538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:17.751863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:17.752338 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:17.752795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:17.753475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:17.753930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:17.754366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:17.901586 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:17.909737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2565758d-f7fb-41b0-a98d-44c64c8ae9c4 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1758 microversion: 2.1 time: 0.169153 Oct 17 10:30:17.910300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 313/602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:17 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:18.225082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:18.225693 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:18.232830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:18.233317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:18.233754 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:18.234471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:18.234931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:18.235356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:18.365830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:18.374105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-013497cb-6671-4988-8984-2919f101548f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.152893 Oct 17 10:30:18.374708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 290/603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:18 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:19.399763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:19.400427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:19.407355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:19.407848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:19.408312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:19.409035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:19.409492 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:19.409917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:19.536920 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:19.545667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d4c26584-8b75-4862-895b-ab16ae401d48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.150479 Oct 17 10:30:19.546372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 314/604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:19 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:20.569866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:20.570570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:20.577061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:20.577542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:20.577979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:20.578695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:20.579151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:20.579575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:20.706904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:20.715702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d96dd88f-8546-4835-a101-90802f4427b0 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.150694 Oct 17 10:30:20.716270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 291/605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:20 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:21.740187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:21.740717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:21.748030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:21.748510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:21.748943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:21.749626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:21.750083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:21.750536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:21.885591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:21.893677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b6722850-f46d-446a-8af0-fa19cc5e72e1 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.157713 Oct 17 10:30:21.894239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 315/606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:21 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:22.916838 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:22.917472 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:22.924138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:22.924622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:22.925054 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:22.925743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:22.926196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:22.926648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:23.056332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:23.064516 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2a750319-b876-42d2-83af-c9f196eec60a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.151800 Oct 17 10:30:23.065111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 292/607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:22 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:24.089169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:24.089778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:24.097038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:24.097518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:24.097951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:24.098674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:24.099125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:24.099544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:24.230058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:24.238123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1ce05041-a145-4d76-b318-959d7cbd865a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.152969 Oct 17 10:30:24.238716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 316/608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:24 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:25.261821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:25.262458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:25.268932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:25.269417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:25.269856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:25.270581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:25.271042 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:25.271475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:25.275687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:25.418094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:25.426739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a45a6d91-87b8-456a-a132-f7d5607b8058 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.169390 Oct 17 10:30:25.427309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 293/609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:25 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:26.455187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:26.455715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:26.462513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:26.463002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:26.463432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:26.464119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:26.464589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:26.465024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:26.484721 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:26.597767 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:26.606342 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ba7b6574-efc8-4b9d-85c2-5a1011331d9a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.155164 Oct 17 10:30:26.606902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 317/610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:26 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:27.629556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:27.630174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:27.636734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.637220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.637656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.638366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.638819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.639245 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.772269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:27.781503 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-95d0583e-b070-4db1-8f90-f8413a452185 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.155794 Oct 17 10:30:27.782078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 294/611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:27 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:27.854899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:27.855395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:27.861622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.862104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.862576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.863265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.863750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.864229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.888392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2857a7a5-1fd4-4b0e-926e-b22430e08f34 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/ips" status: 200 len: 150 microversion: 2.1 time: 0.144748 Oct 17 10:30:27.888939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 318/612] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:30:27 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/ips => generated 150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:30:27.901511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "590fcfe6-add0-404f-8ba4-b387c78bf006"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:27.903987 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:27.909836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.910338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.910792 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.911480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:27.911937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:27.912361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:27.991146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: POST /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/os-volume_attachments HTTP/1.1 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 74 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:30:27.992852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {"volumeAttachment": {"volumeId": "590fcfe6-add0-404f-8ba4-b387c78bf006"}} Oct 17 10:30:27.994683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'server_id': '51aad574-c9a9-4a6e-8210-38ae14243987', 'body': {'volumeAttachment': {'volumeId': '590fcfe6-add0-404f-8ba4-b387c78bf006'}}} Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:27.995674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:27.997263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 400 to user: Invalid volume: volume 590fcfe6-add0-404f-8ba4-b387c78bf006 is already attached to instances: e0dd552f-1059-4d09-a797-ac62de74b383 {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-47061b42-681c-40f6-aa16-3572f5307922 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097939 Oct 17 10:30:27.998758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 295/613] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:30:27 2022] POST /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 10:30:28.003781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:28.004276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:28.011159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.011642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.012079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.012799 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.013257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.013681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.038235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:30:28.122584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7f901a6b-38e8-43a1-810c-83930373fc6b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 204 len: 0 microversion: 2.1 time: 0.122338 Oct 17 10:30:28.123258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 319/614] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:30:27 2022] DELETE /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 10:30:28.131733 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:28.132434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:28.140188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.140613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.141044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.141726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.142175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.142621 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.277354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:28.285142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-595c46a2-dc0b-41a7-ac44-4ead925e7319 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1682 microversion: 2.1 time: 0.157239 Oct 17 10:30:28.285726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 296/615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:28 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:28.805737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:28.807375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:28.813615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.814091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.814562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.815242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:28.815701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:28.816104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:28.947645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:28.955777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bb09b473-3bbf-4241-bad3-dd47d985dcc5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.154361 Oct 17 10:30:28.956369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 320/616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:28 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:29.309156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:29.309766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:29.316196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:29.316670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:29.317097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:29.317780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:29.318228 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:29.318675 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:29.446310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:29.454000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-25b4a127-cf4f-4a31-8b17-2a059859b014 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1682 microversion: 2.1 time: 0.149743 Oct 17 10:30:29.454598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 297/617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:29 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:29.979793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:29.980413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:29.982660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:29.987825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:29.988310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:29.988751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:29.989446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:29.989939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:29.990505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:30.128712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:30.138628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0592419a-62c9-420a-8a6b-b6ff3b958ab8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.163792 Oct 17 10:30:30.139396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 321/618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:29 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:30.477157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:30.477849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:30.480544 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=39 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:30.487768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:30.488294 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:30.488728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:30.489508 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:30.489964 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:30.490425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:30.707241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:30.715774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d0772820-47a2-4bc9-a0af-9d0a976f4ad2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1682 microversion: 2.1 time: 0.242292 Oct 17 10:30:30.716296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 298/619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:30 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:31.170396 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:31.171323 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:31.187095 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.190481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.199485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.200607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.201296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.201965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.257475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aad574-c9a9-4a6e-8210-38ae14243987", "name": "network-vif-deleted", "tag": "4fcf66fa-6ad5-46ee-98fa-e103523d2a0f"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:31.282503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.283273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.283697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.300670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] Creating event network-vif-deleted:4fcf66fa-6ad5-46ee-98fa-e103523d2a0f for instance 51aad574-c9a9-4a6e-8210-38ae14243987 on hv-cinder-86020 Oct 17 10:30:31.312930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-dd9d2ba8-11b9-4bb8-ad69-ac80154c8f27 req-996284ae-e964-49a1-9484-70d51c4232b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197049 Oct 17 10:30:31.318505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 322/620] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:31.426375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:31.437230 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3df9b6a4-04c3-42c6-af09-1a813cbd1121 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.277258 Oct 17 10:30:31.438507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 299/621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:31 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:31.740757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:31.741798 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:31.750314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.752069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.752878 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.753675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.754197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.754843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.794148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:31.794772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:31.795301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:31.795810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'fault' on Instance uuid 51aad574-c9a9-4a6e-8210-38ae14243987 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:31.852334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:31.862289 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c0d3096b-53cd-4426-8847-e12681cdefb6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 200 len: 1331 microversion: 2.1 time: 0.126897 Oct 17 10:30:31.865823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 323/622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:31 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:32.464302 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:32.465121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:32.472140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:32.472638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:32.473086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:32.473794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:32.474248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:32.475940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:32.662158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:32.676218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-43164b5f-8c5c-474e-8781-8b939d689a34 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.217010 Oct 17 10:30:32.676854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 300/623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:32 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:32.887934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:32.888636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:32.895291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:32.895785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:32.896222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:32.896935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:32.897393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:32.897851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:32.911780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 HTTP/1.1 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:30:32.913463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:30:32.915078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '51aad574-c9a9-4a6e-8210-38ae14243987'} Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:30:32.916404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:30:32.917636 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:32.919021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:30:32.919021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fa579bb8-e152-46fd-b957-f58354c5db6d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 404 len: 111 microversion: 2.1 time: 0.032222 Oct 17 10:30:32.919021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 324/624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:32 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:30:32.924394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7d7c21b8-5e21-4273-a848-2a55e908ab8b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '.version_select at 0x7fe9babc7310>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:32.948653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7d7c21b8-5e21-4273-a848-2a55e908ab8b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987499390" status: 202 len: 0 microversion: 2.1 time: 0.027943 Oct 17 10:30:32.950177 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 301/625] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 17 10:30:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987499390 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:30:33.666637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:33.667083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:33.673567 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.674045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.674519 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.675243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.675699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.676118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.701098 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:33.701694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:33.709546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.710036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.710499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.711199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.711662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.712588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.812348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'services' on Instance uuid e0dd552f-1059-4d09-a797-ac62de74b383 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:33.862222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:33.871420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4acba770-9abc-4447-ae96-229f7d6ba7d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.175226 Oct 17 10:30:33.871919 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 302/626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:33 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:33.939553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bc745148-f73d-43f0-a8ba-030be929f1a4 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments/590fcfe6-add0-404f-8ba4-b387c78bf006" status: 202 len: 0 microversion: 2.1 time: 0.278278 Oct 17 10:30:33.940134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 325/627] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:30:33 2022] DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments/590fcfe6-add0-404f-8ba4-b387c78bf006 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:30:33.950295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:33.952639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:33.959658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.960151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.960624 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.961339 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:33.961801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:33.963643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:33.995990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-01981920-c37b-4521-9b3d-65e1099ea0e6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051109 Oct 17 10:30:33.996574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 303/628] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:30:33 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:34.896665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:34.897358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:34.904451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:34.904944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:34.905382 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:34.906138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:34.906725 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:34.907158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:35.008926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:35.011748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:35.023501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:35.024182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:35.025680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:35.026800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:35.027422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:35.028023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:35.050753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:35.065612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-01c8b073-4859-4dee-9352-00cb382e5daf tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.173568 Oct 17 10:30:35.067274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 326/629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:34 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:35.072436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c2644f2a-074e-488f-aba1-458a2d6e1395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067518 Oct 17 10:30:35.082085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 304/630] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:30:35 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:30:36.088892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:36.089459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:36.089988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:36.091447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:36.096852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.097435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.097874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.098432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.098727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.099221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.099542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.099656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.099992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.100684 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.101162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.101582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.133257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5a7a1486-dcaf-431f-9115-9fe5ffe80fce tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048483 Oct 17 10:30:36.134757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 327/631] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:30:36 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:30:36.215456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:36.215944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:36.225776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.226272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.226738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.228016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.228541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.229227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.253022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:36.255950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:30:36.263989 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9bacde11-c937-4412-b2b3-17020c065195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.178990 Oct 17 10:30:36.264564 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 305/632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:36 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:36.332564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2f42cde3-acfb-4710-9a37-243c1da69cbd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 204 len: 0 microversion: 2.1 time: 0.120711 Oct 17 10:30:36.333087 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 328/633] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:30:36 2022] DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 10:30:36.342983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:36.343635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:36.350224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.350737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.351168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.351942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:36.352398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:36.352841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:36.487834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:36.496333 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e43d55a1-f3f4-461f-ab01-65eded4982b2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1682 microversion: 2.1 time: 0.158299 Oct 17 10:30:36.497124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 306/634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:36 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:37.288692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:37.289511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:37.296418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.296900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.297324 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.298054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.298505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.298932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.431770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:37.440331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-45f98cc4-6535-488e-ba91-97e7310cc382 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.155899 Oct 17 10:30:37.441734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 329/635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:37 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:37.520736 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:37.521511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:37.529066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.529614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.530562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.530934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.531449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.531934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.542085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:37.543156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:37.549342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.550015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.550649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.551518 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:37.552239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:37.552828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:37.683646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:37.691989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-42dcea95-eb54-4619-b20d-42d0e4843303 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1682 microversion: 2.1 time: 0.174886 Oct 17 10:30:37.702897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 330/636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:37 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:37.728136 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lazy-loading 'services' on Instance uuid 8d1f19cb-20df-4e33-810d-5e2ced70ef28 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:37.843933 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-603bd74f-1a2e-4786-affd-36b0bf88c2c9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments/42b1e80d-8c3d-4483-8c83-e5d7c770ff55" status: 202 len: 0 microversion: 2.1 time: 0.408597 Oct 17 10:30:37.844784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 307/637] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:30:37 2022] DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments/42b1e80d-8c3d-4483-8c83-e5d7c770ff55 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 10:30:38.465874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:38.466478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:38.474034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:38.474555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:38.474985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:38.475669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:38.476115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:38.476533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:38.499077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:38.622066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:38.630476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cff06a87-d72d-49f3-94f0-93c428d496d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.169239 Oct 17 10:30:38.631049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 331/638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:38 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:38.717304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:38.717939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:38.724605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:38.725084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:38.725514 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:38.726194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:38.726675 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:38.727096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:38.858642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:38.866258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-74b1ea88-5180-4448-a511-3e4d11e15f48 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1682 microversion: 2.1 time: 0.153340 Oct 17 10:30:38.866859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 308/639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:38 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:39.653518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:39.654098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:39.660534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:39.661014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:39.661449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:39.662132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:39.662609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:39.663035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:39.791966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:39.800008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fc0ca49b-a8f9-427f-af1b-181b83616195 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.150418 Oct 17 10:30:39.800576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 332/640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:39 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:39.889060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:39.889679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:39.896043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:39.896524 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:39.896974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:39.897644 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:39.898097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:39.898549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:40.026784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:40.034360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-33424115-2ef8-46d2-b60e-68b41b7aa382 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1682 microversion: 2.1 time: 0.149122 Oct 17 10:30:40.034923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 309/641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:39 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:40.824247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:40.824844 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:40.831762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:40.832247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:40.832679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:40.833396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:40.833841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:40.834286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:40.975849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:40.985132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1a56cdae-d9ba-4643-ac86-8a2ab28fb9f8 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1736 microversion: 2.1 time: 0.165720 Oct 17 10:30:40.985723 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 333/642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:40 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:41.059180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:41.059793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:41.067677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.068493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.069096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.069965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.070732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.071952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.082091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:41.088056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.088618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.089117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.094153 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:41.112174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Going to try to stop instance {{(pid=118679) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 10:30:41.159211 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-422b2eac-d0db-4a28-9551-3293cc63026a tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action" status: 202 len: 0 microversion: 2.1 time: 0.080678 Oct 17 10:30:41.159845 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 334/643] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:30:41 2022] POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 10:30:41.170696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:41.171707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:41.178402 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.178896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.179333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.180030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.180998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.181729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.183589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:41.191786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5d1c68b2-0a78-48b6-92a7-b877b6fa53c8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1615 microversion: 2.1 time: 0.137886 Oct 17 10:30:41.192495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 310/644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:41 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:41.326444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:41.335264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2855c508-7bac-4c5d-8f9b-58cf489c21f3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1724 microversion: 2.1 time: 0.168556 Oct 17 10:30:41.335926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 335/645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:41 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:41.457685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0dd552f-1059-4d09-a797-ac62de74b383", "name": "network-vif-deleted", "tag": "05903ad8-a4e1-4f5e-afb2-0494b0e2bc16"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:41.467600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:41.468165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:41.468603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:41.481372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] Creating event network-vif-deleted:05903ad8-a4e1-4f5e-afb2-0494b0e2bc16 for instance e0dd552f-1059-4d09-a797-ac62de74b383 on hv-cinder-86020 Oct 17 10:30:41.496388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-76264587-7683-4eee-af1e-59fbed6d1dae req-46d8ba4c-f074-48d7-b224-904019e9c990 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042249 Oct 17 10:30:41.497546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 311/646] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:42.008871 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:42.010193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.016889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.017374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.017806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.018861 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.019320 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.019743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.173695 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:42.182082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b52bbf41-43b3-4586-8405-c34b50b46931 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1716 microversion: 2.1 time: 0.177101 Oct 17 10:30:42.183003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 336/647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:42 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:42.217800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:42.218903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.225244 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.225729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.226168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.226914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.227423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.228184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.248739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:42.249229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.255647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.256135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.256567 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.257267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.257719 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.258157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.260496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.260925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.261361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.262001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'fault' on Instance uuid e0dd552f-1059-4d09-a797-ac62de74b383 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:42.319411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:42.328378 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cd0c6175-9079-4686-85a1-9582bfc0e22a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 200 len: 1332 microversion: 2.1 time: 0.115238 Oct 17 10:30:42.329018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 312/648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:42 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:42.348873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] HTTP exception thrown: Cannot 'detach_volume' instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 while it is in vm_state rescued Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Request method failure captured: Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments/902df21d-34b0-429f-954f-fcb18fb664d8 HTTP/1.1 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1sYYDqPa3ZPabsb82n69Y41F0qIoycJWZKiTtOBwPhQy3X0yvQ0Ne200anV_Wsh-KIWYESSS9OEYllFUJzYoZQgsRv_C9mlkadCT_0bevJlxA6mKLY4lfk0qT2La-x09QrztXKi8PIhpVtNhq7jfzhH7AUNNgLuU5Fr9F3MX7ddwg Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:30:42.350542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: aaedb0e1920a42eb97e8dc2f3ec76905 Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:30:42.352003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Cannot 'detach_volume' instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 while it is in vm_state rescued Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'server_id': '11c512a4-6f18-43c9-81e9-ff733da8bbb3', 'id': '902df21d-34b0-429f-954f-fcb18fb664d8'} Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:30:42.352712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 while it is in vm_state rescued Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 while it is in vm_state rescued Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:30:42.354424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Returning 409 to user: Cannot 'detach_volume' instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 while it is in vm_state rescued {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:30:42.355666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-44aecb4f-5696-4181-be67-110180dbdbef tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments/902df21d-34b0-429f-954f-fcb18fb664d8" status: 409 len: 152 microversion: 2.1 time: 0.107922 Oct 17 10:30:42.355666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 337/649] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:30:42 2022] DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments/902df21d-34b0-429f-954f-fcb18fb664d8 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 10:30:42.359695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:42.360314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.363317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:42.364198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.367308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.367816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.368289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.369171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.369986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.370610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.371466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.371953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.372642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.373392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.373851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.374454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.450287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5483d207-51c4-4fb0-a6d4-27e8c3b1c50d tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/action" status: 202 len: 0 microversion: 2.1 time: 0.090401 Oct 17 10:30:42.450926 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 338/650] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:30:42 2022] POST /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:30:42.459491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:42.460396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:42.467057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.467598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.468089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.468848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:42.469369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:42.469993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:42.518586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:42.529123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9a166797-4068-4bc4-b392-ea55ebfb88a0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.173892 Oct 17 10:30:42.529861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 313/651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:42 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:42.612872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:42.621115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-21640ade-5e1b-47f3-9acb-238413e15648 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1724 microversion: 2.1 time: 0.165723 Oct 17 10:30:42.621679 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 339/652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:42 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:43.353236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:43.353788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:43.360449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.360924 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.361352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.362032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.362510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.362928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.376659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 HTTP/1.1 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:30:43.378271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:30:43.379833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'e0dd552f-1059-4d09-a797-ac62de74b383'} Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:30:43.380718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:30:43.382161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:43.384460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:30:43.384460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5f58e73e-60eb-4be8-bab4-8602c20241eb tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 404 len: 111 microversion: 2.1 time: 0.030463 Oct 17 10:30:43.384460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 314/653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:43 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:30:43.389467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-17448e4a-12a8-4f56-a874-d34f0c5c555d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '.version_select at 0x7fe9ba5ffca0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:43.409003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-17448e4a-12a8-4f56-a874-d34f0c5c555d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788114868" status: 202 len: 0 microversion: 2.1 time: 0.023255 Oct 17 10:30:43.409553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 340/654] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 10:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788114868 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:30:43.557361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:43.557980 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:43.564135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.564858 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.565489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.566728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.566728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.567118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.644333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:43.644972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:43.654166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.654737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.655175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.655880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:43.656336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:43.656763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:43.710149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:43.718343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a8fc7c6a-bd43-4cad-85ac-6a6c46399b51 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.166614 Oct 17 10:30:43.719029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 315/655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:43 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:43.863849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:43.872843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8c912883-433b-4e9b-8200-a5c6a90bff80 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1724 microversion: 2.1 time: 0.232498 Oct 17 10:30:43.873411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 341/656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:43 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:44.130207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a529d951-ebe0-453d-98ad-e65aca8d7559 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: .version_select at 0x7fe9ba768940>, body: {"keypair": {"name": "tempest-keypair-1694988136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU3NZRahn2qlgxe1O6Hx8ZBTDwwTHlGf7Yhn6vdbIoTZI0B8/Cc8rPQQPHqhz7acOHPynEMBMXiPTRmO0sc97O4sgZSscL7/4K7LcX5nNt7EwY479zey8UONPl5KWH6uA=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:44.145799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a529d951-ebe0-453d-98ad-e65aca8d7559 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:30:44.150547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-a529d951-ebe0-453d-98ad-e65aca8d7559 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:30:44.173408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a529d951-ebe0-453d-98ad-e65aca8d7559 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047047 Oct 17 10:30:44.174607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 316/657] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:30:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:44.742070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:44.742712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:44.749509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:44.750011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:44.750451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:44.751143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:44.751598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:44.752023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:44.885557 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:44.893278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-780fce83-174e-4b8e-8bef-4f2d24ed413f tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.155124 Oct 17 10:30:44.893944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 342/658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:44 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:44.899838 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:44.900565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:44.906716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:44.907305 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:44.908096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:44.909069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:44.909432 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:44.909948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:45.140421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:45.148581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5fd04696-ac8e-4bd6-b782-a0eadbdb41a2 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1724 microversion: 2.1 time: 0.253165 Oct 17 10:30:45.149143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 317/659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:44 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:45.479692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305632848", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad62b422-f6a9-44d6-866f-37a78f2fcbac"}], "security_groups": [{"name": "tempest-securitygroup--1909679430"}], "key_name": "tempest-keypair-1694988136", "user_data": "}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:45.583152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] validate_networks() for [('ad62b422-f6a9-44d6-866f-37a78f2fcbac', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:30:45.917292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:45.917909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:45.924824 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:45.925671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:45.926107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:45.926834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:45.927284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:45.927709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.066090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:46.075687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2afb1f3d-a6cb-4382-b472-1bb883941df9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.161700 Oct 17 10:30:46.076273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 318/660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:45 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:46.171271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:46.171859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:46.177597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.178079 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.178546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.179239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.179682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.180098 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.251899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:30:46.252379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:30:46.252896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:30:46.253317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:30:46.253734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:30:46.262872 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.263331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.263766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.264497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.264959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.265387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.282831 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:30:46.286922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:30:46.298464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:30:46.300773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:30:46.310792 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:46.319175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1f554384-f4aa-4b82-a226-fe21d5d70cc3 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1730 microversion: 2.1 time: 0.151704 Oct 17 10:30:46.319840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 319/661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:46 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:46.344751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:46.345241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:46.351038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-61758b48-837b-49bf-ac7b-d20fd6d71fcd tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.876482 Oct 17 10:30:46.351800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 343/662] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:30:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 10:30:46.352463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.352766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.353206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.353914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:46.354651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:46.355075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:46.364003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d9ec782a-470c-471c-9799-ffb4940cd832 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:46.364645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d9ec782a-470c-471c-9799-ffb4940cd832 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:46.424436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d9ec782a-470c-471c-9799-ffb4940cd832 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:46.433042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d9ec782a-470c-471c-9799-ffb4940cd832 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1241 microversion: 2.1 time: 0.073403 Oct 17 10:30:46.433748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 344/663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:46 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:46.481549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-44334b9c-c8e0-4070-9bd2-24b38b7e734f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140843 Oct 17 10:30:46.482149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 320/664] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:30:46 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:30:47.099069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:47.099686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:47.107882 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:47.108373 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:47.108953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:47.109659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:47.110149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:47.110997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:47.252149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:47.263819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3577aba0-b1bb-4acb-a8de-71a247d3cbe6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.168570 Oct 17 10:30:47.264432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 345/665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:47 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:47.458047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:47.459231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:47.465381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:47.466243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:47.466713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:47.467417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:47.467874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:47.468463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:47.797145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:47.804930 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7d619ce6-33f1-4797-9b17-1ed5f15ac254 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1293 microversion: 2.1 time: 0.351673 Oct 17 10:30:47.806049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 321/666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:47 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:48.181994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:48.192112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:48.192688 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:48.193201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:48.205087 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] Creating event network-changed:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:30:48.210112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-4fffc753-de69-4721-b7bd-75d04c8e0a67 req-2196a798-7740-4e3d-a45c-34aa9c853694 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031913 Oct 17 10:30:48.210804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 346/667] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:48.287832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:48.288607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:48.295535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:48.296107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:48.296588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:48.297344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:48.297868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:48.298376 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:48.602261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:48.611556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-90720b2c-9269-4c10-805e-2f07e9d2b3d0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.327484 Oct 17 10:30:48.612130 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 322/668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:48 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:48.829072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:48.830012 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:48.836776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:48.837598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:48.838227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:48.839534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:48.840268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:48.841211 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:48.917472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:48.926883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d65a7a9b-0b47-4e6b-8a24-ab0cfaaa97c1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1299 microversion: 2.1 time: 0.102063 Oct 17 10:30:48.927678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 347/669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:48 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:49.637727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:49.638614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:49.645021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:49.645506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:49.645941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:49.646672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:49.647155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:49.647558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:49.896881 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:49.905882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-93607700-9167-4035-9b14-94c51273b7fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.273801 Oct 17 10:30:49.906729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 323/670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:49 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:49.950969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:49.952186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:49.958529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:49.959018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:49.959471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:49.960147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:49.960601 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:49.961031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:50.099005 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:50.107935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1b5f0962-e975-4864-8adf-2c7cc3ff147f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.160875 Oct 17 10:30:50.108500 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 348/671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:49 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:50.228238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}, {"name": "network-changed", "server_uuid": "b72c375f-ee9a-4b63-acc8-a2ac6bc2240d", "tag": "a4988059-c6df-4884-b84c-2138e3c60d51"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:50.240530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:50.241058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:50.241492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:50.255493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Creating event network-changed:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:30:50.255994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] Creating event network-changed:a4988059-c6df-4884-b84c-2138e3c60d51 for instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d on hv-cinder-86020 Oct 17 10:30:50.263402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-82ce1e72-a845-46ca-ae87-6759d3a2ee05 req-3ab7a1ea-0607-4b32-8696-191f7384babd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039763 Oct 17 10:30:50.264193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 324/672] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:30:50.930371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:50.931361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:50.937369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:50.938109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:50.938663 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:50.939365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:50.939860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:50.940285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:50.959870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:51.080157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:51.089185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c365d35a-beb9-4e3c-86c0-d0c3a3bf9c59 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.162687 Oct 17 10:30:51.089756 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 349/673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:50 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:51.130855 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:51.131547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:51.138635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:51.139112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:51.139539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:51.140219 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:51.140669 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:51.141088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:51.505115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:51.513352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b4097706-eb04-49a8-82d8-632fe036e13b tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.386720 Oct 17 10:30:51.513925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 325/674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:51 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:52.112800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:52.113413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:52.120000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:52.120489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:52.120931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:52.121635 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:52.122083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:52.122551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:52.252369 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:52.260694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e29455e1-2c70-43b3-9c93-6dd535f75b2b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.151776 Oct 17 10:30:52.261250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 350/675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:52 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:52.535896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:52.536513 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:52.543655 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:52.544140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:52.544577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:52.545268 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:52.545750 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:52.546159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:52.674202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:52.682852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8056ebf5-0346-4f11-8c67-3664b3a14c42 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.150867 Oct 17 10:30:52.683417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 326/676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:52 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:53.283462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:53.284069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:53.290537 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.291071 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.291471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.292096 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.292553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.292984 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.359264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:53.359754 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:53.365703 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.366186 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.366650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.367339 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.367815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.368236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.393854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:30:53.421552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:53.429469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b6167e9e-042f-427a-9009-5e14e506851d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.149786 Oct 17 10:30:53.430044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 351/677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:53 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:53.471908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fe631906-3238-4361-853a-d13646b4c329 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "DELETE /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 204 len: 0 microversion: 2.1 time: 0.116330 Oct 17 10:30:53.472494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 327/678] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:30:53 2022] DELETE /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:30:53.480741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:53.481359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:53.487196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.487676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.488105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.488788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.489239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.489660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.624934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:53.632773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fb4ca2e1-fd3d-4e9d-9f46-770a911d4114 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1578 microversion: 2.1 time: 0.156122 Oct 17 10:30:53.633343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 352/679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:53 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:53.706627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:53.707376 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:53.713915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.714468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.714909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.715604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:53.716087 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:53.716510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:53.720594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:53.850041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:53.857903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6f3e0252-0d3a-4658-b0f9-e07cc4327517 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.155600 Oct 17 10:30:53.858501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 328/680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:53 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:54.453390 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:54.453995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:54.460532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.461014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.461447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:54.462164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.463160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.463622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:54.590981 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:54.598579 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b83e7864-d20e-4bad-a79e-3ee645d101aa tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1678 microversion: 2.1 time: 0.149058 Oct 17 10:30:54.599143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 353/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:54 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:54.657101 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:54.657711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:54.659573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:54.664751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.665229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.665660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:54.667035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.667489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.667909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:54.797812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:54.806068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-82cb6f42-fbc3-4587-a01d-a0421af4fffd tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1578 microversion: 2.1 time: 0.152735 Oct 17 10:30:54.807038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 329/682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:54 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:54.880064 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:54.880821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:54.888409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.888906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.889344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:54.890047 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:54.890539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:54.890965 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.025032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:55.033282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7908d12f-71d7-45ec-b9fd-29f780aa3cea tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.157070 Oct 17 10:30:55.033897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 354/683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:54 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:55.622687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:55.623214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:55.629373 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:55.629857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:55.630296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.631013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:55.631472 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:55.631891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.834572 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:55.835391 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:55.842772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:55.843267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:55.843706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.844410 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:55.844877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:55.845311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.931311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:55.942954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8c4b495b-445d-441c-b7ab-e7411d3cb462 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1655 microversion: 2.1 time: 0.324181 Oct 17 10:30:55.943685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 330/684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:55 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1655 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:55.967214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:55.973406 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:55.974126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:55.974748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:55.988213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:55.997171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0478a746-ccf6-4621-859f-b5c71cbfdccf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1578 microversion: 2.1 time: 0.168120 Oct 17 10:30:55.997972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 355/685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:55 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:56.000030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Going to try to start instance {{(pid=118680) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 10:30:56.045779 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-544adda6-d861-4663-8195-2e3b82f40287 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action" status: 202 len: 0 microversion: 2.1 time: 0.083468 Oct 17 10:30:56.046515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 331/686] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:30:55 2022] POST /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 10:30:56.054545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:56.055287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:56.055434 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:56.055986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:56.062039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:56.063193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:56.064134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:56.064721 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:56.065496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:56.065982 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:56.066437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:56.067018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:56.067555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:56.068521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:56.069208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:56.069859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:56.221005 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:56.229827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-670d160e-e1ec-4005-a0bb-c9dfa2083d30 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1664 microversion: 2.1 time: 0.178179 Oct 17 10:30:56.231189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 356/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:56 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:56.404434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:56.412687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-582af9da-a96c-4cfe-a335-382e400d8395 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.361647 Oct 17 10:30:56.426558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 332/688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:56 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:57.032488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:57.033793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:57.042062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:57.043936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=8 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:57.046667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:57.049738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.051655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.052641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.053745 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.054906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.055510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.131874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12170369-6077-4716-adf0-a110aebc1525", "name": "network-vif-deleted", "tag": "74d28022-6cac-4006-bf30-27fb6aed74d9"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:57.149180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.150301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.151611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.170571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] Creating event network-vif-deleted:74d28022-6cac-4006-bf30-27fb6aed74d9 for instance 12170369-6077-4716-adf0-a110aebc1525 on hv-cinder-86020 Oct 17 10:30:57.176451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-47dd6f77-3bc7-44f1-af90-88a05f600aeb req-a2f5f47e-b8d0-4fa6-9aab-3ca1b01ff8fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049676 Oct 17 10:30:57.177451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 333/689] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:30:57.194253 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:57.209293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dcf2ade5-1f91-487b-b650-d037e0d69d3c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1510 microversion: 2.1 time: 0.191676 Oct 17 10:30:57.209896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 357/690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:57 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:57.255253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:57.255968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:57.263659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.264917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.265560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.266902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.267424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.267909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.415249 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:57.423124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9e69ff96-3295-42ae-b11b-d8e86929cd88 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1664 microversion: 2.1 time: 0.172865 Oct 17 10:30:57.423888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 334/691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:57 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:57.449543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:57.450181 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:57.456148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.456633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.457064 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.457755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:57.458208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:57.458660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:57.598955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:57.608210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ea506a2a-2ce6-48a7-a974-e7f6535c5d00 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.163147 Oct 17 10:30:57.609327 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 358/692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:57 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:58.234216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:58.234851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:58.241107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.241645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.242014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.242694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.243143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.243560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.275001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.275613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.276215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.276671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lazy-loading 'fault' on Instance uuid 12170369-6077-4716-adf0-a110aebc1525 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:30:58.320219 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:58.329086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e81dd94f-a672-4b77-a6a9-ca99e49223f7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 200 len: 1230 microversion: 2.1 time: 0.098938 Oct 17 10:30:58.329657 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 335/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:58 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:30:58.449410 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:58.451061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:58.458381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.459579 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.460024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.460880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.461509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.462281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.606755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:58.615919 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6c7a76e3-dee9-45b2-880c-51429fc4118e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1668 microversion: 2.1 time: 0.172325 Oct 17 10:30:58.616625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 359/694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:58 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:58.642901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:58.643629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:58.650061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.659282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.660176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.661617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.662814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.662814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.674882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72c375f-ee9a-4b63-acc8-a2ac6bc2240d", "name": "network-vif-plugged", "status": "completed", "tag": "a4988059-c6df-4884-b84c-2138e3c60d51"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:58.685948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:58.686480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:58.686910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:58.699706 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] Creating event network-vif-plugged:a4988059-c6df-4884-b84c-2138e3c60d51 for instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d on hv-cinder-86020 Oct 17 10:30:58.705192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-c8e197fa-22e5-49e0-b827-58166ef3b483 req-04981185-be60-4458-984d-51476e2032ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099551 Oct 17 10:30:58.706312 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 336/695] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:30:58.809507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:58.817063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-036e0fb6-fb7a-4d5a-a280-bdc3776ecff5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.187575 Oct 17 10:30:58.817622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 360/696] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:58 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:30:59.352559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:59.353711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:59.355963 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:30:59.361549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.362040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.362515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.363204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.363660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.364082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.379775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] HTTP exception thrown: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Request method failure captured: Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 HTTP/1.1 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS29WE27LbpbscF_NjyBFuLq3r1eIbsgIr5rsv9nIfACdyRnHQNoo7JneuQtJsteugli0ii9-LU4SZpsi4mRQsLbMk_N-VwEyZlMyyCMk2RgdUmMrwQihDi3yZZcXDKMH1IKxN788N-nHNKLf5EX-ih8JN_JrnM55vgg9cSoK44TSU8 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:30:59.381662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e87741d68c74ae29ecea930893e3449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-TestVolumeBootPattern-244674561 Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: a5b7190649694b9882ab34c0f3114a3e Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:30:59.383303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '12170369-6077-4716-adf0-a110aebc1525'} Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:30:59.384221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:30:59.385786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:30:59.387195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Returning 404 to user: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:30:59.387195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8b60dc2f-935b-43af-9ed1-70c8de72aba7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 404 len: 111 microversion: 2.1 time: 0.035313 Oct 17 10:30:59.387195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 337/697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:59 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:30:59.476855 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-967949387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785350402", "security_groups": [{"name": "tempest-secgroup-smoke-1119150375"}], "block_device_mapping_v2": [{"uuid": "4b2f6e2c-8a97-40ea-9317-a4d2bba62757", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6600083-efa1-4cdc-8469-423af4747abb"}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:30:59.587990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] validate_networks() for [('e6600083-efa1-4cdc-8469-423af4747abb', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:30:59.841686 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:30:59.842296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:30:59.848466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.848949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.849390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.850080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.850565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.850992 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.954209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:30:59.954659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:30:59.955160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:30:59.955566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:30:59.955975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:30:59.965411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.965895 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.966347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.967077 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:30:59.967532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:30:59.967953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:30:59.985431 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:30:59.985595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:30:59.989574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for user a5b7190649694b9882ab34c0f3114a3e and project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:30:59.993134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8223d0d2-00b3-4e69-8d45-3cf14ad95248 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1367 microversion: 2.1 time: 0.156188 Oct 17 10:30:59.993694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 338/698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:30:59 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:31:00.046626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:31:00.048781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2f6e2c-8a97-40ea-9317-a4d2bba62757',volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:31:00.176368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-aec7c3e2-dffe-4f85-9f50-52d2eea0585f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703213 Oct 17 10:31:00.177049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 361/699] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:30:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:31:00.189468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-02aa6dcd-3d89-4dda-9f33-d61d5e7253b6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:00.190124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-02aa6dcd-3d89-4dda-9f33-d61d5e7253b6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:00.255153 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-02aa6dcd-3d89-4dda-9f33-d61d5e7253b6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:00.263023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-02aa6dcd-3d89-4dda-9f33-d61d5e7253b6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1093 microversion: 2.1 time: 0.077483 Oct 17 10:31:00.263570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 339/700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:00 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:01.017212 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:01.017824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:01.024392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.024875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.025902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.026659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.027118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.027542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.157468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:01.165135 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f2553674-b5e8-42ad-b27f-32740cde8267 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1557 microversion: 2.1 time: 0.152348 Oct 17 10:31:01.165722 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 362/701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:01 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:01.187720 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:01.188250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:01.194580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.195062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.195502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.196192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.196646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.197768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.273588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-12ad3801-3c23-47e4-a09f-5da6cb840aa2 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089674 Oct 17 10:31:01.274185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 340/702] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:31:01 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:01.287542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:01.288156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:01.293949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.294475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.294912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.295610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:01.296073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:01.296497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:01.356592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:01.364652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-94ce404c-86c9-48a4-ade8-5898a3321bf8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1135 microversion: 2.1 time: 0.080780 Oct 17 10:31:01.365358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 363/703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:01 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1135 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:02.389742 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:02.390430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:02.396675 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:02.397171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:02.397652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:02.398436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:02.398904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:02.399334 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:02.486445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:02.494289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-00de543c-e3cd-4cad-ba5c-1ef70df13600 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1209 microversion: 2.1 time: 0.109701 Oct 17 10:31:02.494889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 341/704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:02 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:02.761475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b72c375f-ee9a-4b63-acc8-a2ac6bc2240d", "tag": "a4988059-c6df-4884-b84c-2138e3c60d51"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:02.771776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:02.772347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:02.772853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:02.784396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] Creating event network-changed:a4988059-c6df-4884-b84c-2138e3c60d51 for instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d on hv-cinder-86020 Oct 17 10:31:02.791438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-0e3bb231-2221-4657-afbb-5d5e6c037fe5 req-6667f95d-b142-4c24-8e8b-d1c0adfbbafa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Oct 17 10:31:02.792333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 364/705] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:03.518616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:03.519236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:03.525986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:03.526659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:03.527068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:03.527777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:03.528238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:03.528664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:03.875608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:03.883724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b6f06de3-a34c-4012-9353-5e0f3de9a649 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.369092 Oct 17 10:31:03.884308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 342/706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:03 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:04.891345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7", "tag": "ce13d5d3-e1be-4216-ad2c-ea8b09580322"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:04.900911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:04.901473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:04.901900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:04.910052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:04.910703 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:04.913410 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] Creating event network-changed:ce13d5d3-e1be-4216-ad2c-ea8b09580322 for instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 on hv-cinder-86020 Oct 17 10:31:04.917998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:04.918172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-017fc8ad-f929-47fd-93ac-3f6e259dba7f req-596089f6-a650-45ca-8a3c-00501d878ec3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031405 Oct 17 10:31:04.918523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:04.919474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:04.920241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:04.920867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 365/707] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:04.921000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:04.921105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:05.124218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:05.132424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a648b14a-7108-4f38-9514-c103bac94394 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.226050 Oct 17 10:31:05.133010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 343/708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:04 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:31:06.159893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:06.160307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:06.166435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:06.166928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:06.167361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:06.168057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:06.168527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:06.168929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:06.301996 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:06.309862 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3d0c99f9-df37-41ea-b5a7-21c98c1a2e99 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.155225 Oct 17 10:31:06.310446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 366/709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:06 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:07.332843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:07.333402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:07.340616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:07.341102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:07.341541 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:07.342235 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:07.342727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:07.343156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:07.473562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:07.482258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d6316724-1ad3-4c0c-8b7c-34d626c1a2c7 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.153392 Oct 17 10:31:07.482870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 344/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:07 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:08.504624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:08.505348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:08.511778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:08.512260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:08.512697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:08.513383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:08.513838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:08.514259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:08.643525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:08.651776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8c483f79-2f07-4338-a95b-a7a5be2dafd3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.150914 Oct 17 10:31:08.652390 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 367/711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:08 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:09.676117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:09.676641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:09.684106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:09.684584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:09.685012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:09.685694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:09.686143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:09.686590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:09.821562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:09.829310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-85ffcd92-26b9-4cbe-9f18-1f905c3bfca6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.157119 Oct 17 10:31:09.830075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 345/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:09 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:10.852157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:10.852724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:10.855472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:10.856235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:10.861891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:10.862393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:10.862832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:10.863517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:10.863973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:10.864395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:10.868491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:11.041114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:11.048976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e5a443a7-4f9f-43ad-960b-db946539416d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.200751 Oct 17 10:31:11.049544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 368/713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:10 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:12.073078 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:12.073714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:12.075608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:12.081914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:12.082432 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:12.082870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:12.083575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:12.084030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:12.084457 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:12.214420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:12.217865 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:12.223054 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-57acabb0-866e-4781-8af7-dd3464265455 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.154277 Oct 17 10:31:12.223458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 346/714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:12 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:13.246449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:13.246964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:13.253345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:13.253819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:13.254246 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:13.254951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:13.255400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:13.255817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:13.385349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:13.393050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-89023c4a-16ca-4cab-b55e-23d70aec542c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.151074 Oct 17 10:31:13.393618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 369/715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:13 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:14.416316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:14.416991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:14.424644 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:14.425129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:14.425563 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:14.426282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:14.426762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:14.427184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:14.561157 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:14.569012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2cbb1422-1557-45d7-8739-9e0604dac5aa tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.157626 Oct 17 10:31:14.569593 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 347/716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:14 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:15.591940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:15.592496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:15.598908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:15.599396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:15.599833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:15.600527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:15.600985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:15.601413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:15.734125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:15.741775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-77b36288-20c4-4247-94d1-61dc77ad08d1 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.153888 Oct 17 10:31:15.742361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 370/717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:15 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:16.746242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7", "name": "network-vif-plugged", "status": "completed", "tag": "ce13d5d3-e1be-4216-ad2c-ea8b09580322"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:16.757364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:16.757843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:16.760870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:16.765449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:16.766058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:16.772203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] Creating event network-vif-plugged:ce13d5d3-e1be-4216-ad2c-ea8b09580322 for instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 on hv-cinder-86020 Oct 17 10:31:16.772374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:16.772812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:16.773240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:16.773928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:16.774399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:16.775384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:16.778697 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-9100e463-b275-4b04-a3ef-41694c4716ac req-ba6fdd68-cd2f-49b7-b37d-b72c6de3c76a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Oct 17 10:31:16.779772 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 348/718] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:16.907449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:16.915022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c35f8dc4-ade2-4e9d-be55-9f1d3a52174f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.153584 Oct 17 10:31:16.915585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 371/719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:16 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:17.937479 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:17.938371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:17.945156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:17.945639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:17.946070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:17.947141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:17.947467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:17.947888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:18.081496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:18.089766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1c262cf8-7326-4f90-9c2e-90872fa406be tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1265 microversion: 2.1 time: 0.156448 Oct 17 10:31:18.090350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 349/720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:17 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:19.112282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:19.112883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:19.120515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.120988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.121416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.122107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.122576 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.122993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.256108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:19.264033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-dbe9c59d-d410-430c-a540-3f05f92b235d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1453 microversion: 2.1 time: 0.155528 Oct 17 10:31:19.264599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 372/721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:19 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:19.285941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:19.286574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:19.293695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.294166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.294622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.295321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.295762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.296182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.429241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:19.436942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2594552c-825f-42b2-b336-aa4322ae2373 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1453 microversion: 2.1 time: 0.154835 Oct 17 10:31:19.437501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 350/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:19 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:19.500216 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-75946106"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:19.500743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:19.506660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.507143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.507574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.508260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:19.508707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:19.509639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:19.638188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.network.security_group_api [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Removing security group ada0ccf3-d083-438e-a1ca-038111f8b652 from port 9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 Oct 17 10:31:19.994533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9f70747d-c21a-404d-b9f8-4de70318465d tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action" status: 202 len: 0 microversion: 2.1 time: 0.497570 Oct 17 10:31:19.998475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 373/723] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:31:19 2022] POST /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:31:20.075342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:20.085868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:20.086645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:20.088557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:20.099782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] Creating event network-changed:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:31:20.105826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-481c23eb-2a0e-4eec-a479-cdb9a717c4a9 req-6e10ba3e-a4d9-4838-8e40-bc03257e2856 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103708 Oct 17 10:31:20.106448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 351/724] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:21.339630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:21.340153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:21.364777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:21.365464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:21.365901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:21.366642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:21.367093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:21.367729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:21.460668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lazy-loading 'services' on Instance uuid 3fa918d9-d80d-4fe0-aaa0-46d064dce92f {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:31:21.544801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-681216d9-54ed-462f-b85c-6a2a9b9bf1d9 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments/9de49492-d44c-49fc-ba30-c85248d49547" status: 202 len: 0 microversion: 2.1 time: 0.209546 Oct 17 10:31:21.545833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 374/725] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:31:21 2022] DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments/9de49492-d44c-49fc-ba30-c85248d49547 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:31:21.554730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:21.567202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:21.579285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:21.579782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:21.580224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:21.581555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:21.582046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:21.582511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:21.616068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-25d96760-5c6d-43f8-9cc1-ae287fdb42ba tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065754 Oct 17 10:31:21.622263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 352/726] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:31:21 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:31:21.843714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7", "tag": "ce13d5d3-e1be-4216-ad2c-ea8b09580322"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:21.854307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:21.854820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:21.855613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:21.867180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] Creating event network-changed:ce13d5d3-e1be-4216-ad2c-ea8b09580322 for instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 on hv-cinder-86020 Oct 17 10:31:21.872860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-429016cf-6802-4795-a66c-65e1bb16871f req-ec6445f4-c910-4895-b84c-dc451e2ec1b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Oct 17 10:31:21.873453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 375/727] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:22.122659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:22.131908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:22.132467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:22.132901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:22.144585 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] Creating event network-changed:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:31:22.150181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-30731b8c-ea57-4812-ad42-a4ebb295cd8d req-280a07ab-68e1-40b8-b31e-46ef493fe331 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031298 Oct 17 10:31:22.152577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 353/728] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:22.630241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:22.632584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:22.639768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:22.640503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:22.641134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:22.642050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:22.642794 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:22.643423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:22.674824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-215b1106-aeec-4622-bf81-5310a81244fc tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049342 Oct 17 10:31:22.680201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 376/729] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:31:22 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:23.688631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:23.690811 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:23.697511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:23.698010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:23.698473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:23.699160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:23.699607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:23.700073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:23.729784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3af73226-305c-4354-b376-7117fede794a tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045118 Oct 17 10:31:23.730356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 354/730] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:31:23 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:31:23.740910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:23.741438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:23.747977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:23.748452 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:23.748882 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:23.749565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:23.750009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:23.750461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:23.824089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] HTTP exception thrown: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f is not attached to volume 9de49492-d44c-49fc-ba30-c85248d49547 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Request method failure captured: Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments/9de49492-d44c-49fc-ba30-c85248d49547 HTTP/1.1 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS3gJFkvuGwpQ94XGwXrWrzWUhVdWfj0PgxhMIYGJMfVQL6Ru9txu_b1qm1AciwdzZu06dibLUTbtrJU6Xtml5wFcsrXsCTLi8I0OBZvTPc2GQFrwC26cp1Y9dwydvQMvZ6Wa2c7R7ghDQ1ykydqVtNQlXrVjT4-11gtd1ORLdbvYPE Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: cc21860aa70345c79cfe597d5a42fb51 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:31:23.826489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: cc21860aa70345c79cfe597d5a42fb51 Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-TestMinimumBasicScenario-1448214952-project Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 973791f2609b4b55aa986e9fd9baceec Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-TestMinimumBasicScenario-1448214952-project Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:31:23.828055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f is not attached to volume 9de49492-d44c-49fc-ba30-c85248d49547 Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'server_id': '3fa918d9-d80d-4fe0-aaa0-46d064dce92f', 'id': '9de49492-d44c-49fc-ba30-c85248d49547'} Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9de49492-d44c-49fc-ba30-c85248d49547. Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:31:23.828931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f is not attached to volume 9de49492-d44c-49fc-ba30-c85248d49547 Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f is not attached to volume 9de49492-d44c-49fc-ba30-c85248d49547 Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:23.830681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Returning 404 to user: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f is not attached to volume 9de49492-d44c-49fc-ba30-c85248d49547 {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:31:23.832009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f2fdd1f7-1dff-431e-997d-bb8e0a6e69ff tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments/9de49492-d44c-49fc-ba30-c85248d49547" status: 404 len: 154 microversion: 2.1 time: 0.090952 Oct 17 10:31:23.832009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 377/731] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:31:23 2022] DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f/os-volume_attachments/9de49492-d44c-49fc-ba30-c85248d49547 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:31:24.968667 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:24.969176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:24.975617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:24.976104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:24.976546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:24.977241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:24.978206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:24.978674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:25.003442 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:31:25.076523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-be33be1c-4e2c-4659-9504-18cf4d7b571b tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 204 len: 0 microversion: 2.1 time: 0.111161 Oct 17 10:31:25.077347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 355/732] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:31:24 2022] DELETE /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:31:25.087249 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:25.088469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:25.094350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:25.094880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:25.095314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:25.096039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:25.096492 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:25.096912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:25.226066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:25.234823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b2dce20d-e7b2-459e-8853-fcf351fead94 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1554 microversion: 2.1 time: 0.152722 Oct 17 10:31:25.235390 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 378/733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:25 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:26.259470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:26.260480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:26.266940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:26.267416 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:26.267848 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:26.268523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:26.268970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:26.269386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:26.398058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:26.406417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ebfd2728-0fda-4782-9cdf-3248f9e630b2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1554 microversion: 2.1 time: 0.151752 Oct 17 10:31:26.406981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 356/734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:26 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:27.429650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:27.430461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:27.433907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:27.440039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:27.440603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:27.441042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:27.442063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:27.442955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:27.443420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:27.590238 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:27.603381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-99899bc9-1113-4469-b183-781b18646864 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1554 microversion: 2.1 time: 0.178036 Oct 17 10:31:27.604438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 379/735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:27 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:28.100337 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa918d9-d80d-4fe0-aaa0-46d064dce92f", "name": "network-vif-deleted", "tag": "9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:28.112976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:28.113454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:28.113883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:28.127194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] Creating event network-vif-deleted:9a7e0e9e-6a03-4ec0-9d95-983fb99ac8d4 for instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f on hv-cinder-86020 Oct 17 10:31:28.132663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-77a08199-4f71-4a7b-9a94-c2a965ebe004 req-21e8582d-d69b-4ea3-9aea-49b45e3ef0ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036324 Oct 17 10:31:28.134271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 357/736] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:28.628177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:28.628703 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:28.635553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:28.636028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:28.636456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:28.637136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:28.637584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:28.637996 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:28.668979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:28.669455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:28.669880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:28.670317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lazy-loading 'fault' on Instance uuid 3fa918d9-d80d-4fe0-aaa0-46d064dce92f {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:31:28.709829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973791f2609b4b55aa986e9fd9baceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc21860aa70345c79cfe597d5a42fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:28.718169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c9b4f601-b993-437e-9eec-057e16bd9ef2 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 200 len: 1349 microversion: 2.1 time: 0.093899 Oct 17 10:31:28.718765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 380/737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:28 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:29.742745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:29.743441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] [instance: 3fa918d9-d80d-4fe0-aaa0-46d064dce92f] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:29.750046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:29.750560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:29.750993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:29.751682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:29.752138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:29.752561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:29.765599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] HTTP exception thrown: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Request method failure captured: Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f HTTP/1.1 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS3gJFkvuGwpQ94XGwXrWrzWUhVdWfj0PgxhMIYGJMfVQL6Ru9txu_b1qm1AciwdzZu06dibLUTbtrJU6Xtml5wFcsrXsCTLi8I0OBZvTPc2GQFrwC26cp1Y9dwydvQMvZ6Wa2c7R7ghDQ1ykydqVtNQlXrVjT4-11gtd1ORLdbvYPE Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: cc21860aa70345c79cfe597d5a42fb51 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:31:29.767234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc21860aa70345c79cfe597d5a42fb51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: cc21860aa70345c79cfe597d5a42fb51 Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1448214952 Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-TestMinimumBasicScenario-1448214952-project Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 973791f2609b4b55aa986e9fd9baceec Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-TestMinimumBasicScenario-1448214952-project Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. Oct 17 10:31:29.768759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '3fa918d9-d80d-4fe0-aaa0-46d064dce92f'} Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:31:29.769676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. Oct 17 10:31:29.771162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:31:29.772557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Returning 404 to user: Instance 3fa918d9-d80d-4fe0-aaa0-46d064dce92f could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:31:29.772557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-14b07db1-7daa-408f-9fff-e9caa1b739a3 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f" status: 404 len: 111 microversion: 2.1 time: 0.030247 Oct 17 10:31:29.772557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 358/738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:29 2022] GET /compute/v2.1/servers/3fa918d9-d80d-4fe0-aaa0-46d064dce92f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:31:29.777764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7e90aacb-cc03-4497-89d1-dc4ecfacacd1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] Calling method '.version_select at 0x7fe9ba5ff940>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:29.797336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7e90aacb-cc03-4497-89d1-dc4ecfacacd1 tempest-TestMinimumBasicScenario-1448214952 tempest-TestMinimumBasicScenario-1448214952-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1890178727" status: 202 len: 0 microversion: 2.1 time: 0.023915 Oct 17 10:31:29.797898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 381/739] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 17 10:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1890178727 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:31:46.161565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:46.162097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:46.164711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:46.165573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:46.171403 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:46.171885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:46.172322 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:46.173012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:46.173463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:46.173887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:46.256629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'services' on Instance uuid 11c512a4-6f18-43c9-81e9-ff733da8bbb3 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:31:46.326210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f0d44431-95f9-4a10-bafe-7f0d49e28c99 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments/902df21d-34b0-429f-954f-fcb18fb664d8" status: 202 len: 0 microversion: 2.1 time: 0.168399 Oct 17 10:31:46.327250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 359/740] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:31:46 2022] DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments/902df21d-34b0-429f-954f-fcb18fb664d8 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:31:46.333038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:46.333741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:31:46.338285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:46.340505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:46.350473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:46.350979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:46.351432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:46.352166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:46.352768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:46.353244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:46.384542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-eb4e9618-af0f-49ca-82c0-270cba5d070a tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052408 Oct 17 10:31:46.385169 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 382/741] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:31:46 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:47.397652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:47.400670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:47.407358 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.407843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.408318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.409009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.409460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.409879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.439473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-28f080cd-2286-4d3a-ac34-4b77953b5ed4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046059 Oct 17 10:31:47.440041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 360/742] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:31:47 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:31:47.526775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:47.527346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:47.533578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.534082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.534546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.535244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.535697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.536120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.561566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:31:47.641506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2cdce52c-95b0-4193-9dd5-30214d764b48 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 204 len: 0 microversion: 2.1 time: 0.119143 Oct 17 10:31:47.642268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 383/743] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:31:47 2022] DELETE /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:31:47.650988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:47.651601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:47.657619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.658104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.658576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.659269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:47.659724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:47.660150 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:47.789153 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:47.797358 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cbe9a103-a819-4eb7-a445-10e62cd09ea4 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1690 microversion: 2.1 time: 0.150478 Oct 17 10:31:47.797931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 361/744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:47 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:31:48.822063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:48.822782 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:48.829028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:48.829509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:48.829944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:48.830657 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:48.831109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:48.831530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:48.964461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:48.972309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-877bbd23-6951-4486-93eb-855ff5b8b466 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1690 microversion: 2.1 time: 0.155035 Oct 17 10:31:48.972883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 384/745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:48 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:49.997329 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:49.997948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:50.005552 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:50.006044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:50.006513 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:50.007233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:50.007701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:50.008173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:50.146852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:50.154542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3fe321bf-e262-4cb6-9be6-4d8efa3d5651 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1690 microversion: 2.1 time: 0.162225 Oct 17 10:31:50.155104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 362/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:49 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:51.177334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:51.177943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:51.184469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:51.184963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:51.185384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:51.186068 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:51.186555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:51.186976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:51.316870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:51.325418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-de41f47b-5c1d-4748-b925-ff9dca9c6a26 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1690 microversion: 2.1 time: 0.151881 Oct 17 10:31:51.326018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 385/747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:51 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:52.261248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c512a4-6f18-43c9-81e9-ff733da8bbb3", "name": "network-vif-deleted", "tag": "8fd77213-3e70-44af-a732-07ce9c5187c5"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:52.271369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:52.271852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:52.272273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:52.284200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] Creating event network-vif-deleted:8fd77213-3e70-44af-a732-07ce9c5187c5 for instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 on hv-cinder-86020 Oct 17 10:31:52.289187 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-d8ed298e-4861-42cb-a6fa-2189138b2c03 req-c4125571-c064-47d1-aaa9-6d4943a34280 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Oct 17 10:31:52.290041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 363/748] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:31:52.349520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:52.350420 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:52.366037 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:52.366624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:52.367075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:52.369230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:52.369802 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:52.370240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:52.456361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:52.465914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5749d8d1-3399-4d71-8197-2e0c6108560f tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1330 microversion: 2.1 time: 0.120493 Oct 17 10:31:52.482860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 386/749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:52 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:53.490994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:53.491724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:53.498857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:53.499353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:53.499798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:53.500479 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:53.500956 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:53.501356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:53.532459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:53.532948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:53.533380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:53.533832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'fault' on Instance uuid 11c512a4-6f18-43c9-81e9-ff733da8bbb3 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:31:53.580940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:53.588533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cd63bb88-ecfc-4200-b218-1c9a0469e0d7 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 200 len: 1335 microversion: 2.1 time: 0.102278 Oct 17 10:31:53.589072 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 364/750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:53 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:31:54.612471 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:54.613084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: 11c512a4-6f18-43c9-81e9-ff733da8bbb3] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:54.619834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:54.620315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:54.620747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:54.621463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:54.621910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:54.622347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:54.635699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] HTTP exception thrown: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Request method failure captured: Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 HTTP/1.1 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1sYYDqPa3ZPabsb82n69Y41F0qIoycJWZKiTtOBwPhQy3X0yvQ0Ne200anV_Wsh-KIWYESSS9OEYllFUJzYoZQgsRv_C9mlkadCT_0bevJlxA6mKLY4lfk0qT2La-x09QrztXKi8PIhpVtNhq7jfzhH7AUNNgLuU5Fr9F3MX7ddwg Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:31:54.637343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: aaedb0e1920a42eb97e8dc2f3ec76905 Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. Oct 17 10:31:54.638956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '11c512a4-6f18-43c9-81e9-ff733da8bbb3'} Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:31:54.639790 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. Oct 17 10:31:54.641250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:31:54.642639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Returning 404 to user: Instance 11c512a4-6f18-43c9-81e9-ff733da8bbb3 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:31:54.642639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-98d43f88-6cc5-43f1-b053-0361f5098660 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3" status: 404 len: 111 microversion: 2.1 time: 0.030151 Oct 17 10:31:54.642639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 387/751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:54 2022] GET /compute/v2.1/servers/11c512a4-6f18-43c9-81e9-ff733da8bbb3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:31:54.647255 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e0feb51e-7ac5-47e2-b9f4-1b861b471c31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '.version_select at 0x7fe9ba5c2160>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:54.667265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e0feb51e-7ac5-47e2-b9f4-1b861b471c31 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436443746" status: 202 len: 0 microversion: 2.1 time: 0.023647 Oct 17 10:31:54.667864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 365/752] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 17 10:31:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436443746 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:31:57.545464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:57.545954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:57.552383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:57.552857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:57.553289 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:57.553994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:57.554458 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:57.554881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:57.579616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:31:57.656164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8ed99a60-51c1-444a-88b4-923eee5e1009 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 204 len: 0 microversion: 2.1 time: 0.114144 Oct 17 10:31:57.656757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 388/753] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:31:57 2022] DELETE /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:31:57.667451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:57.668056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:57.674828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:57.675308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:57.675738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:57.676454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:57.676903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:57.677320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:57.806341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:57.814068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9f779287-4e7e-4ce3-9c28-e744fcae316e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1509 microversion: 2.1 time: 0.152863 Oct 17 10:31:57.814673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 366/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:57 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:31:58.840027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:31:58.840728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:31:58.847718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:58.848204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:58.848634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:58.849341 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:58.849788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:58.850204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:58.995714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:31:59.003952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5355d528-e1e9-467a-bb8d-db4012af8f18 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1509 microversion: 2.1 time: 0.169314 Oct 17 10:31:59.004528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 389/755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:31:58 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:31:59.433441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2dfd38-7528-4af3-88c5-86afe10123b8", "name": "network-vif-deleted", "tag": "8b16d3ef-463a-486f-a242-f0bc1977b822"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:31:59.444947 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:31:59.445419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:31:59.445986 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:31:59.457227 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] Creating event network-vif-deleted:8b16d3ef-463a-486f-a242-f0bc1977b822 for instance fc2dfd38-7528-4af3-88c5-86afe10123b8 on hv-cinder-86020 Oct 17 10:31:59.463619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-4b11af6f-0aa6-422a-865d-4c2b35b65188 req-a63d1d3a-34cb-40d7-830d-5f6dcf818626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Oct 17 10:31:59.464438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 367/756] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:00.027622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:00.028229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:00.034259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:00.034776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:00.035256 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:00.035921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:00.036375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:00.036797 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:00.068821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:00.069309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:00.069742 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:00.070189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'fault' on Instance uuid fc2dfd38-7528-4af3-88c5-86afe10123b8 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:00.121293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:00.129233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-368be24d-f6c0-4f10-93ec-f40b7f7e6db6 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 200 len: 1312 microversion: 2.1 time: 0.105643 Oct 17 10:32:00.129786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 390/757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:00 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:01.152960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:01.153656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: fc2dfd38-7528-4af3-88c5-86afe10123b8] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:01.159843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.160324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.160762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.161450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.161909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.162353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.176004 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] HTTP exception thrown: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Request method failure captured: Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 HTTP/1.1 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1sYYDqPa3ZPabsb82n69Y41F0qIoycJWZKiTtOBwPhQy3X0yvQ0Ne200anV_Wsh-KIWYESSS9OEYllFUJzYoZQgsRv_C9mlkadCT_0bevJlxA6mKLY4lfk0qT2La-x09QrztXKi8PIhpVtNhq7jfzhH7AUNNgLuU5Fr9F3MX7ddwg Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:32:01.177592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: aaedb0e1920a42eb97e8dc2f3ec76905 Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. Oct 17 10:32:01.179431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'fc2dfd38-7528-4af3-88c5-86afe10123b8'} Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:32:01.181287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. Oct 17 10:32:01.182888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:01.184257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Returning 404 to user: Instance fc2dfd38-7528-4af3-88c5-86afe10123b8 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:32:01.184257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cd7f7e02-5bb1-41f2-80b2-9e43cf62de7c tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8" status: 404 len: 111 microversion: 2.1 time: 0.030868 Oct 17 10:32:01.184257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 368/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:01 2022] GET /compute/v2.1/servers/fc2dfd38-7528-4af3-88c5-86afe10123b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:32:01.188526 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:01.189046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:01.197268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.197819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.198254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.199008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.199462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.199885 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.226818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:32:01.305585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6ddea992-1561-43bd-9247-bbf80959076b tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 204 len: 0 microversion: 2.1 time: 0.120363 Oct 17 10:32:01.309482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 391/759] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:32:01 2022] DELETE /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:32:01.314466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:01.315075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:01.321698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.322283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.322617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.323314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:01.323793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:01.324223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:01.459281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:01.467173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-95cf0deb-e3b6-473f-a268-eaa35d2c8395 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.156516 Oct 17 10:32:01.467745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 369/760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:01 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:02.178873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:02.181272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:02.187109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.187589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.188022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.188706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.189290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.189561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.221700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5678f412-3df3-4b64-b0c2-001ec6f6e6fe tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046719 Oct 17 10:32:02.222753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 392/761] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:32:02 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:32:02.288419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:02.288914 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:02.295398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.295889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.296364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.297056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.297519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.297948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.322774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:32:02.396487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f7631229-e5b0-45f2-81ed-cdac43f7698b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 204 len: 0 microversion: 2.1 time: 0.111576 Oct 17 10:32:02.397027 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 370/762] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:32:02 2022] DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:32:02.406031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:02.406667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:02.412523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.413004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.413493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.414217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.414835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.415346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.491017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:02.491724 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:02.497990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.498550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.498996 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.499699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:02.500158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:02.500585 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:02.547317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:02.550898 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:02.556232 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cec94ea2-6c53-4a32-9fa9-703e602447ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1674 microversion: 2.1 time: 0.154330 Oct 17 10:32:02.556801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 393/763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:02 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:02.634198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:02.641925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dd76ee8b-0600-4f64-82c3-1fa259c7ae3e tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.155255 Oct 17 10:32:02.642534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 371/764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:02 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:03.580559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:03.581162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:03.588747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:03.589223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:03.589652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:03.590351 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:03.590804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:03.591223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:03.665505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:03.666134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:03.672537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:03.673026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:03.673464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:03.674163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:03.674643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:03.675073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:03.720718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:03.728801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4f6dfc77-20b4-4c4c-9cdc-d4b7c79ad3fd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1674 microversion: 2.1 time: 0.152060 Oct 17 10:32:03.729729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 394/765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:03 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:03.807300 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:03.815037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-197faf94-ebac-4d5a-b900-99c4c0ae3580 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1521 microversion: 2.1 time: 0.153860 Oct 17 10:32:03.815610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 372/766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:03 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:04.708580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a35982-9d23-4588-965f-96ea10757f72", "name": "network-vif-deleted", "tag": "f398f903-fded-4efd-b6f3-7b669ec7ccce"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:04.723593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.724302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.728392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.754985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:04.756231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:04.769314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.771992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] Creating event network-vif-deleted:f398f903-fded-4efd-b6f3-7b669ec7ccce for instance b0a35982-9d23-4588-965f-96ea10757f72 on hv-cinder-86020 Oct 17 10:32:04.772720 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.773324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.774913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.779141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.779813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.788180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-39a7122f-5a0f-44ab-885d-0d72b8a4e24a req-54025d74-4127-4c4b-a64d-d89cf6aec911 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083468 Oct 17 10:32:04.789482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 395/767] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:04.839312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:04.840422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:04.848577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.849347 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.849962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.850871 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.851493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.851950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.888146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:04.888627 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:04.889054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:04.889733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lazy-loading 'fault' on Instance uuid b0a35982-9d23-4588-965f-96ea10757f72 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:04.937054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaedb0e1920a42eb97e8dc2f3ec76905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895b2d6d988f4ab7a0d9dcf9e130af42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:04.938851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:04.950007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d817698d-f11d-4e1a-9592-05ca4a84c9ab tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1607 microversion: 2.1 time: 0.198783 Oct 17 10:32:04.963444 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 373/768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:04 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1607 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:04.971768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fe4936b8-d928-4324-8b3a-52b1c84075d5 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 200 len: 1311 microversion: 2.1 time: 0.137953 Oct 17 10:32:04.972980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 396/769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:04 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:05.830008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:05.830655 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:05.838594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.839178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.839884 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:05.840598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.841061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.841490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:05.865660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lazy-loading 'flavor' on Instance uuid 4486fcaf-e909-4231-b425-7552ca3eeb54 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:05.912929 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:05.951691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2ae2ba23-9d35-40ea-921c-89048eae33bd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "POST /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54/action" status: 202 len: 0 microversion: 2.1 time: 0.125631 Oct 17 10:32:05.952587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 374/770] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:32:05 2022] POST /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:32:05.960879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:05.962027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:05.970197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.970197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.970676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:05.971386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.971844 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.972396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:05.976014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:05.976785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:05.986228 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.986908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.987391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:05.988105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:05.988518 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:05.989021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:06.027768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:06.028507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:06.029097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:06.029704 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lazy-loading 'fault' on Instance uuid 8d1f19cb-20df-4e33-810d-5e2ced70ef28 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:06.078193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:06.088738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-be0738bf-118d-4f1d-96ae-9fe7e3a3ddf0 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 200 len: 1328 microversion: 2.1 time: 0.116660 Oct 17 10:32:06.089488 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 375/771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:05 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:06.105409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:06.105409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] [instance: b0a35982-9d23-4588-965f-96ea10757f72] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:06.105409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:06.105409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:06.105873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:06.105873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:06.105873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:06.105873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:06.120505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] HTTP exception thrown: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Request method failure captured: Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 HTTP/1.1 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1sYYDqPa3ZPabsb82n69Y41F0qIoycJWZKiTtOBwPhQy3X0yvQ0Ne200anV_Wsh-KIWYESSS9OEYllFUJzYoZQgsRv_C9mlkadCT_0bevJlxA6mKLY4lfk0qT2La-x09QrztXKi8PIhpVtNhq7jfzhH7AUNNgLuU5Fr9F3MX7ddwg Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:32:06.122103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/895b2d6d988f4ab7a0d9dcf9e130af42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 895b2d6d988f4ab7a0d9dcf9e130af42 Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523523233 Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: aaedb0e1920a42eb97e8dc2f3ec76905 Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523523233-project Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. Oct 17 10:32:06.123725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'b0a35982-9d23-4588-965f-96ea10757f72'} Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:32:06.124701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. Oct 17 10:32:06.126288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:32:06.128056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] Returning 404 to user: Instance b0a35982-9d23-4588-965f-96ea10757f72 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:32:06.128993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fde6cb87-7667-44e0-9d11-8bc982208391 tempest-ServerRescueNegativeTestJSON-523523233 tempest-ServerRescueNegativeTestJSON-523523233-project] 10.222.0.16 "GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72" status: 404 len: 111 microversion: 2.1 time: 0.037457 Oct 17 10:32:06.129665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 376/772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:06 2022] GET /compute/v2.1/servers/b0a35982-9d23-4588-965f-96ea10757f72 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:32:06.163998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:06.173538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4dfb32b5-03f3-49d3-93a2-b30acb090bb4 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.216501 Oct 17 10:32:06.174116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 397/773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:05 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:06.891206 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1f19cb-20df-4e33-810d-5e2ced70ef28", "name": "network-vif-deleted", "tag": "1195ec6d-7c1a-4c0b-92b5-beb07772c367"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:06.901591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:06.902063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:06.902590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:06.913574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] Creating event network-vif-deleted:1195ec6d-7c1a-4c0b-92b5-beb07772c367 for instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 on hv-cinder-86020 Oct 17 10:32:06.919039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-926b448a-d527-499b-ba5d-338fd4c46c4c req-acf654bb-ed12-4ba7-8d16-979db2541e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031499 Oct 17 10:32:06.919629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 377/774] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:07.112974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:07.113583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:07.120904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:07.121427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:07.121856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:07.122594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:07.123054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:07.123472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:07.137217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 HTTP/1.1 Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:32:07.138899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:32:07.140523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '8d1f19cb-20df-4e33-810d-5e2ced70ef28'} Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:32:07.141465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:32:07.142943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:07.144158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:32:07.144158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-921ad398-769a-4187-b8d2-d78438b9add3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 404 len: 111 microversion: 2.1 time: 0.031335 Oct 17 10:32:07.144158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 398/775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:07 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:32:07.151187 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d3c432ea-5b3a-4016-80a5-14a190ad058d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '.version_select at 0x7fe9ba5d79d0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:07.170411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d3c432ea-5b3a-4016-80a5-14a190ad058d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372430957" status: 202 len: 0 microversion: 2.1 time: 0.024394 Oct 17 10:32:07.171104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 378/776] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 10:32:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372430957 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:32:07.197586 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:07.198228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:07.204258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:07.204874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:07.205414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:07.206228 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:07.206806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:07.207362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:07.425329 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:07.442721 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f359ad7a-8c79-42c1-80e8-ea3f167f31fa tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.249260 Oct 17 10:32:07.458421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 399/777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:07 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:07.976554 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ce4cc6ff-eb08-46c4-8c6f-0aaecec9600c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: .version_select at 0x7fe9ba5b3940>, body: {"keypair": {"name": "tempest-keypair-1650359443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGug9GBdjKIdxO2jIs3SOlM//gUVtFl0q9mZWr0Y4YVkDqnP/4T2fW739P/chm4KA+pNv8PAOqoeF4+TMyANlcPT8vH17fg17CCS2RC4oe6xGlHPNaEWu+/8UHiK4Oe0ZA=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:08.002568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-ce4cc6ff-eb08-46c4-8c6f-0aaecec9600c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:08.007351 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-ce4cc6ff-eb08-46c4-8c6f-0aaecec9600c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for user eb7c6da9fd3c4b72a687daa923d07918 and project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:08.036257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ce4cc6ff-eb08-46c4-8c6f-0aaecec9600c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065020 Oct 17 10:32:08.037531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 379/778] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:32:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:08.472201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:08.473416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:08.481439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:08.482290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:08.482907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:08.483809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:08.484521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:08.485119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:08.974056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:08.983866 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4914163f-edcc-43af-9785-466d6f78aff3 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.515724 Oct 17 10:32:08.984588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 400/779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:08 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:10.007665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:10.009083 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:10.017262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:10.017972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:10.018446 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:10.019214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:10.019834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:10.020408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:10.149879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1044535386", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec7b89aa-8615-42a5-9a24-4f31d3ebca8d"}], "security_groups": [{"name": "tempest-securitygroup--1635736975"}], "key_name": "tempest-keypair-1650359443", "user_data": "}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:10.242928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:10.253044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aa600af3-ed35-4732-a04c-20ed3328c415 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.249345 Oct 17 10:32:10.254607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 380/780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:10 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:10.284967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] validate_networks() for [('ec7b89aa-8615-42a5-9a24-4f31d3ebca8d', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:32:10.679018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:32:10.679449 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:32:10.680053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:32:10.680609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:32:10.681088 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:32:10.690096 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:10.690845 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:10.691313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:10.692120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:10.692583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:10.693009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:10.710544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:10.715042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Getting quotas for user eb7c6da9fd3c4b72a687daa923d07918 and project 9ad3932c3fcc4d42b77b26f889ac694f. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:10.726125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:32:10.728619 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:32:10.777364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8b8bc9bd-8ebd-49c6-9990-a8eab412be17 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632446 Oct 17 10:32:10.778254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 401/781] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:32:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:32:10.788820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-231dee54-ac39-4543-8e8c-e908596cdc80 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:10.789461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-231dee54-ac39-4543-8e8c-e908596cdc80 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:10.848002 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-231dee54-ac39-4543-8e8c-e908596cdc80 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:10.859608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-231dee54-ac39-4543-8e8c-e908596cdc80 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1238 microversion: 2.1 time: 0.074421 Oct 17 10:32:10.860195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 381/782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:10 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:11.288127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:11.292113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:11.299039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:11.299526 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:11.300088 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:11.300830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:11.301285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:11.301702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:11.495995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:11.507416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e65dc47e-de84-42c6-b88d-c70f35ff005a tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.226467 Oct 17 10:32:11.527846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 402/783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:11 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:11.883901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:11.885167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:11.892876 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:11.893629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:11.894064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:11.894791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:11.895247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:11.895667 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:11.962616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:11.972642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e08cb60a-58ad-4a95-be0c-86c3cb049482 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1290 microversion: 2.1 time: 0.094042 Oct 17 10:32:11.973570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 382/784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:11 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:12.538843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:12.541254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:12.551779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:12.552552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:12.553171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:12.554070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:12.554722 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:12.555304 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:12.798104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:12.810017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-86321813-ff55-4cdf-9ecd-419732fd0b24 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.277596 Oct 17 10:32:12.811394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 403/785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:12 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:13.006599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:13.008386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:13.030278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:13.031213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:13.034470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:13.035531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:13.036784 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:13.037467 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:13.421676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:13.431647 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e0faad39-962e-46d7-b1ed-c6f745fe85b9 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.437777 Oct 17 10:32:13.432408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 383/786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:12 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:13.837776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:13.839296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:13.846352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:13.846839 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:13.847519 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:13.848240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:13.848727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:13.849823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:13.948129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0213217-d654-40f4-a65f-0515383c1b09", "tag": "234eeab0-608b-4862-ba56-6aedf471e915"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:13.958622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:13.959651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:13.960387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:13.978387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] Creating event network-changed:234eeab0-608b-4862-ba56-6aedf471e915 for instance f0213217-d654-40f4-a65f-0515383c1b09 on hv-cinder-86020 Oct 17 10:32:13.984362 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-a081c86d-3803-4ee2-8cc7-3697865a0437 req-a5e7b414-fd1e-4627-b98e-3d6f9539f42c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040640 Oct 17 10:32:13.986292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 384/787] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:32:14.220364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:14.230159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-315f421d-7819-4641-9b09-3f2095792b25 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.398544 Oct 17 10:32:14.230846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 404/788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:13 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:14.457023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:14.458404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:14.469463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:14.469958 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:14.470420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:14.471136 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:14.471783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:14.472218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:14.790684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:14.800179 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c08dfb77-7b59-43e4-86f6-a286cb600d57 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.347723 Oct 17 10:32:14.801085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 385/789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:14 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:15.256716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:15.257334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:15.264392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:15.265104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:15.265561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:15.266467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:15.267089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:15.267675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:15.426971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:15.440067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3eb64ff0-08c1-4105-bd29-93f019f0df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.187039 Oct 17 10:32:15.458475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 405/790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:15 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:15.826586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:15.827700 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:15.834673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:15.836030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:15.837236 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:15.838381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:15.839014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:15.839444 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:16.084022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:16.103267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-62f4d871-feff-432a-9709-7a9647f25606 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.281530 Oct 17 10:32:16.115912 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 386/791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:15 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:16.465843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:16.467680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:16.470546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:16.483302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:16.483905 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:16.484429 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:16.485269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:16.485782 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:16.486274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:16.643532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:16.652484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ca51a732-00f9-458e-aa7a-ee4c7150d947 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.191970 Oct 17 10:32:16.653066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 406/792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:16 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:16.819237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ead8de6e-0bf8-48d1-8818-5d81aa1b1ce2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: .version_select at 0x7fe9ba7b20d0>, body: {"keypair": {"name": "tempest-keypair-1914329244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKF9UJCeyx0yxbCfoAgAIp+I+UTbW2Txj1TDa78hzbA95BEDxHnyxYYtS5SkojbmTbi/9sJKeKP2Y5wyvVry5mkLWHkuvspqxvgSRoNyETgvHafaQ8BrxHH52TvrqbhOg=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:16.825505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:16.841786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-ead8de6e-0bf8-48d1-8818-5d81aa1b1ce2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:16.846066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-ead8de6e-0bf8-48d1-8818-5d81aa1b1ce2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for user e5efdc755c6a43f9b8cf570ac38b25eb and project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:16.871502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ead8de6e-0bf8-48d1-8818-5d81aa1b1ce2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.168822 Oct 17 10:32:16.872096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 387/793] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 17 10:32:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 10:32:17.131821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:17.132583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:17.142185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:17.143046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:17.144062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:17.145555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:17.146486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:17.148074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:17.326039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:17.335213 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-aa04382c-2e33-488e-8d98-a00bb5c59fd3 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.212715 Oct 17 10:32:17.335786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 407/794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:17 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:17.676790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:17.677663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:17.685301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:17.686105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:17.686781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:17.687712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:17.688389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:17.689088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:18.050886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:18.066447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-408449eb-645d-41e0-9b0b-d9d988d2957e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.392727 Oct 17 10:32:18.069247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 388/795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:17 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:18.357874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:18.359417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:18.366859 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:18.368142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:18.368772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:18.369720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:18.370411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:18.371054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:18.466532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1321568311", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fd95ede-ecf3-40ce-8613-a421ab553445"}], "security_groups": [{"name": "tempest-securitygroup--620972275"}], "key_name": "tempest-keypair-1914329244", "user_data": "}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:18.524838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:18.533250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5917c682-9e36-4f89-ab74-8c36cc29e30d tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.179425 Oct 17 10:32:18.534530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 408/796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:18 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:18.586607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] validate_networks() for [('4fd95ede-ecf3-40ce-8613-a421ab553445', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:32:19.026474 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:19.026896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:19.030171 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:32:19.030695 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:32:19.031170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:32:19.031581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:32:19.031994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:32:19.033329 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.034025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.034490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.035193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.035648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.036076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.041445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.041926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.042387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.043113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.043569 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.043990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.069574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:19.075018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for user e5efdc755c6a43f9b8cf570ac38b25eb and project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:19.076909 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-39dfd65d-4df7-459f-b0d3-3ace207b1ec5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/ips" status: 200 len: 150 microversion: 2.1 time: 0.055594 Oct 17 10:32:19.092246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:32:19.095056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:32:19.097779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 409/797] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:32:19 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:19.105772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:19.107551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:19.127772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.128354 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.128928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.130086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.130605 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.131103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.178880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0c10c505-b5c4-4d2c-b4ba-41be5e837a3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.716634 Oct 17 10:32:19.184615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 389/798] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 17 10:32:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 10:32:19.196335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:19.197590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:19.283417 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:19.295359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:19.303401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:19.306394 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dfd5a33f-5f56-4b05-986d-522988f8ac48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1282 microversion: 2.20 time: 0.117736 Oct 17 10:32:19.307694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 390/799] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:19 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:19.361915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:19.375892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-996a8ecc-00e7-46c9-b32d-550525849f48 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.274495 Oct 17 10:32:19.377225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 410/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:19 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:19.557213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:19.558039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:19.566687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.567185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.567619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.568324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:19.568776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:19.569198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:19.792531 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:19.800856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-91105dd8-63d2-4032-ab6a-f15108fdc196 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.247943 Oct 17 10:32:19.801708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 391/801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:19 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:20.332453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:20.333448 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:20.345374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.346153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.346687 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.347412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.347875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.348301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.402217 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:20.403215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:20.418780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.419270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.419904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.420766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.421432 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.421858 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.425656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:20.436143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:20.438178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:20.439329 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-344d8948-2879-4a70-9889-a69e7f7d05d0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1278 microversion: 2.20 time: 0.111294 Oct 17 10:32:20.439940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 411/802] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:20 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:20.567388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:20.576061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3bd7ba91-8178-4477-bba5-dae65d1de4b9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.179291 Oct 17 10:32:20.576816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 392/803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:20 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:20.707028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:20.711877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a626a6c-2165-453f-91e7-9eb62d51a71c"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:20.714264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:20.720476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.720952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.721379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.722129 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.722603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.723115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.723544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:20.741816 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:20.825080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:20.825617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:20.832111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.832595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.833029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.833715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:20.834287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:20.834752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:20.985329 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:20.994356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aa5ba31b-e77d-4a2b-b321-f76a6203e73c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.173715 Oct 17 10:32:20.995066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 393/804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:20 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:21.100718 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8c3927a3-02d3-427d-93cd-fb046ce37946 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393386 Oct 17 10:32:21.102264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 412/805] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:32:20 2022] POST /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:21.465300 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:21.465920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:21.467668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0213217-d654-40f4-a65f-0515383c1b09", "name": "network-vif-plugged", "status": "completed", "tag": "234eeab0-608b-4862-ba56-6aedf471e915"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:21.477988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.478662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.479822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.480011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.480800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.481062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.481475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.481870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.482595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.519048 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] Creating event network-vif-plugged:234eeab0-608b-4862-ba56-6aedf471e915 for instance f0213217-d654-40f4-a65f-0515383c1b09 on hv-cinder-86020 Oct 17 10:32:21.525463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-ba52277b-7485-439d-bd2a-46498150cce3 req-26f6124a-c1e1-4f4b-97b9-cfca31631f11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062654 Oct 17 10:32:21.527791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 413/806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:21.602935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:21.605166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:21.608601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:21.614966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.615877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.616877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.618756 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.619515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.620167 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.620960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:21.622622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:21.624663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-124e532a-4bef-4440-ad13-55457d85f74e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1340 microversion: 2.20 time: 0.163541 Oct 17 10:32:21.626148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 394/807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:21 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1340 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:21.784843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:21.793562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-60f208d4-cb67-4792-8c24-406a4838520c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1570 microversion: 2.1 time: 0.196490 Oct 17 10:32:21.794193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 414/808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:21 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:21.817546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:21.818248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:21.825304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.826107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.826539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.827663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:21.828128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:21.829413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:21.886699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118680) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 10:32:21.985597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-efd9ae3c-d995-4215-b6a5-4e773be786ac tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "POST /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54/action" status: 202 len: 0 microversion: 2.1 time: 0.171912 Oct 17 10:32:21.986060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 395/809] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 17 10:32:21 2022] POST /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:32:21.995608 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:21.996407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:22.004034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.004817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.005509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.006372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.006953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.007566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.017038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:22.017919 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:22.025366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.037549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.038402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.039934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.040905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.041550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.225164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:22.236580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c2be2593-85de-4c3d-a010-8e32f0829c28 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1518 microversion: 2.1 time: 0.245992 Oct 17 10:32:22.238043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 415/810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:21 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1518 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:22.401108 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:22.405367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:22.415997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f71e3be0-2d0a-4cbc-a06a-80051ee336a1 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.402770 Oct 17 10:32:22.416994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 396/811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:22 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:22.652373 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:22.653305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:22.660570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.661296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.662018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.663076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.663691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.664800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.824624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:22.835801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:22.837777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:22.839155 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-427ad69f-57c1-453f-ac59-f3f66203f2e6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.191081 Oct 17 10:32:22.839724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 416/812] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:22 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:22.967288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:22.979258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:22.980084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:22.980523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:22.992194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] Creating event network-changed:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:32:22.997451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-6b948360-7edc-455e-88a0-7c8fcff2230c req-2cd96c20-0764-4a18-865a-1ad05a041e82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033853 Oct 17 10:32:22.998076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 397/813] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:23.264569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:23.265187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:23.271188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.271678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.272116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.272812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.273315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.274515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.411117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:23.419648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4ce0e447-d86b-4975-8570-afbbfb618bbd tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1518 microversion: 2.1 time: 0.158911 Oct 17 10:32:23.420468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 417/814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:23 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:23.441239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:23.442017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:23.449782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.450278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.450765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.451519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.451917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.452341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.544267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "name": "network-vif-unplugged", "status": "completed", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:23.553515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.553987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.554433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.566038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.compute.server_external_events [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] Unable to find a host for instance 4486fcaf-e909-4231-b425-7552ca3eeb54. Dropping event network-vif-unplugged {{(pid=118679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 10:32:23.566933 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-b93c7342-69a7-429b-b707-2101f7b09783 req-b9365cdf-9640-412a-a58d-ff2bdf5be12b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026603 Oct 17 10:32:23.568180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 418/815] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 17 10:32:23.864753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:23.865441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:23.873125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.873614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.874052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.874812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:23.875266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:23.875689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:23.927365 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:23.936511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a59e5d83-4727-4a9e-b0ff-e52a77d02741 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1364 microversion: 2.1 time: 0.500232 Oct 17 10:32:23.937089 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 398/816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:23 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:24.012423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:24.020475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:24.022092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:24.023226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3138a3f-a6b0-48f9-a274-992d7d62a46e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.162624 Oct 17 10:32:24.023814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 419/817] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:23 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:32:24.444542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:24.445201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:24.451910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:24.452406 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:24.452845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:24.453547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:24.454003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:24.454640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:24.668114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:24.676059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e38d1623-b172-4206-b43b-eec7f3ade24d tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1520 microversion: 2.1 time: 0.236375 Oct 17 10:32:24.676640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 399/818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:24 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:24.960158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:24.960701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:24.967330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:24.967813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:24.968245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:24.968936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:24.969389 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:24.969810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.047735 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:25.048348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:25.054542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.055787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.056223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.056928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.057390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.057823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.103963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:25.112165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8fb9ace5-bff9-443b-8e0a-b623e57d2b46 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1550 microversion: 2.1 time: 0.155983 Oct 17 10:32:25.112830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 420/819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:24 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:25.135848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:25.136348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:25.142209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.142803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.143230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.143915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.144366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.144785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.191766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:25.200063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:25.201513 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:25.202719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c89cfcdb-b771-43b6-b925-f05cb0e5a000 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.158942 Oct 17 10:32:25.203496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 400/820] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:25 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:32:25.223461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-49582bce-1c84-4dd3-82a6-67f2970ebd5e tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091942 Oct 17 10:32:25.224076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 421/821] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:32:25 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:32:25.700627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:25.701233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:25.707791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.708274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.708704 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.709438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:25.710052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:25.710612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:25.847722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:25.855942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cf8da9e8-27b6-4ef4-8604-0a35d36b096b tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1520 microversion: 2.1 time: 0.159138 Oct 17 10:32:25.856519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 401/822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:25 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:26.165230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0213217-d654-40f4-a65f-0515383c1b09", "tag": "234eeab0-608b-4862-ba56-6aedf471e915"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:26.174848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:26.175322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:26.175744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:26.187046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] Creating event network-changed:234eeab0-608b-4862-ba56-6aedf471e915 for instance f0213217-d654-40f4-a65f-0515383c1b09 on hv-cinder-86020 Oct 17 10:32:26.192119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-e22739b6-d7f1-4f93-8b98-941fad99e88b req-4893bbac-64dd-4281-8d45-4f14fd74fa48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030973 Oct 17 10:32:26.192707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 422/823] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:26.228715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:26.229740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:26.235955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:26.236438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:26.236879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:26.237618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:26.238074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:26.238540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:26.373867 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:26.381838 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:26.383586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:26.384689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fc8615d2-38f2-4a45-add4-27e3a142d168 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.160208 Oct 17 10:32:26.385267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 402/824] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:26 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:26.880221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:26.880918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:26.887399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:26.887888 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:26.888356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:26.889059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:26.889549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:26.890004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:27.040416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:27.049313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a2e4b28c-3163-48b4-93ad-4d4e1482df05 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1520 microversion: 2.1 time: 0.173376 Oct 17 10:32:27.050140 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 423/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:26 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:27.409278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:27.409935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:27.416847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:27.417341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:27.417775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:27.418511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:27.418969 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:27.419395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:27.551664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:27.560885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:27.562350 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:27.563473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7ab709d4-c590-4c7b-ad18-1a97cb592d3c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.158183 Oct 17 10:32:27.564030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 403/826] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:27 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:28.072480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:28.073092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:28.079328 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.079808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.080237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.081257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.081359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.081753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.214568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:28.222993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-75686c62-afde-40e4-ac2c-1f8275849330 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1520 microversion: 2.1 time: 0.154607 Oct 17 10:32:28.223562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 424/827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:28 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:28.589924 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:28.590558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:28.596889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.597486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.597938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.598632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.599163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.599484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.702210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a626a6c-2165-453f-91e7-9eb62d51a71c"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:28.704581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:28.710366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.711596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.712364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.713055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.713504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.713922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.735116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:28.743142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:28.744578 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:28.745791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e91b9685-55a3-4919-b7df-839d3552d5e8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.160117 Oct 17 10:32:28.746258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 404/828] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:28 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:28.793610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: POST /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments HTTP/1.1 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 74 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:32:28.795359 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {"volumeAttachment": {"volumeId": "7a626a6c-2165-453f-91e7-9eb62d51a71c"}} Oct 17 10:32:28.796949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'server_id': 'b72c375f-ee9a-4b63-acc8-a2ac6bc2240d', 'body': {'volumeAttachment': {'volumeId': '7a626a6c-2165-453f-91e7-9eb62d51a71c'}}} Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:28.797912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:28.799677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 400 to user: Invalid volume: volume 7a626a6c-2165-453f-91e7-9eb62d51a71c is already attached to instances: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ed2c4c66-ac44-4ade-a804-7de6efbb106e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099159 Oct 17 10:32:28.801319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 425/829] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:32:28 2022] POST /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 10:32:28.866687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:28.867739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:28.873755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.874257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.874740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.875433 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:28.875890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:28.876315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:28.958502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'services' on Instance uuid b72c375f-ee9a-4b63-acc8-a2ac6bc2240d {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:29.031271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-80527d13-69d2-4a09-b3ea-3dc973b64ae5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments/7a626a6c-2165-453f-91e7-9eb62d51a71c" status: 202 len: 0 microversion: 2.1 time: 0.168429 Oct 17 10:32:29.031866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 405/830] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:32:28 2022] DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments/7a626a6c-2165-453f-91e7-9eb62d51a71c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:32:29.042301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:29.044660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:29.060436 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.060931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.061368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.062076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.062678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.063221 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.095896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5a8cd5f0-1037-47de-9f73-560dec61d7a3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059640 Oct 17 10:32:29.096493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 426/831] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:32:29 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:29.245210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:29.249753 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:29.250508 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:29.257275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.258392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.258900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.259535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.259995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.260424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.291870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=18 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:29.403207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:29.414225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-df9be137-aa75-41da-917a-ab235a5d134f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.169858 Oct 17 10:32:29.414870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 406/832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:29 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:29.771336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:29.771943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:29.778311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.778819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.779272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.781134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:29.781633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:29.782060 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:29.924414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:29.933694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:29.935708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:29.936846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-617d29f6-96ee-4193-a6cc-d119eb2ab0f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.170135 Oct 17 10:32:29.937416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 427/833] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:29 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:30.110008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:30.113336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:30.120762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.121241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.121670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.122759 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.123221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.123640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.162051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-92336597-7214-4fa6-8779-21f91e64d6df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056812 Oct 17 10:32:30.162668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 407/834] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:32:30 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 10:32:30.238623 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:30.239133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:30.246164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.246687 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.247788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.248665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.249127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.249547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.276419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:32:30.330574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:30.372492 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-eaca103a-2ada-4ba6-adff-84c5df559660 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 204 len: 0 microversion: 2.1 time: 0.137307 Oct 17 10:32:30.373092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 428/835] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:32:30 2022] DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:32:30.384081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:30.384700 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:30.390788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.391291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.391737 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.392449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.392909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.393337 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.437811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:30.438582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:30.444497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.445023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.445414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.446110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.446597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.447021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.528327 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:30.536181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-263c7ea2-a1e4-432b-90ba-8648d28c5856 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1682 microversion: 2.1 time: 0.158787 Oct 17 10:32:30.536761 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 408/836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:30 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:30.583880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:30.592081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-075d2178-9423-404d-b1c5-45928079240f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.158459 Oct 17 10:32:30.592640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 429/837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:30 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:30.963826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:30.964353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:30.970352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.970847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.971282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:30.971971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:30.972426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:30.972850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.103067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:31.111669 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:31.113119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:31.114223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-50b536ce-751c-4129-89a5-4761bc13b85d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.155156 Oct 17 10:32:31.114813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 409/838] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:30 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:31.303882 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "name": "network-vif-plugged", "status": "completed", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:31.315222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:31.315595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:31.316006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.328107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] Creating event network-vif-plugged:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:32:31.332955 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-c926c3c8-b95c-47a6-a463-e96959b83fd1 req-74d656fc-4b60-4ac6-8e00-918f1ad175b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Oct 17 10:32:31.333549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 430/839] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:31.560619 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:31.561149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:31.567553 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:31.568036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:31.568462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.569138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:31.569587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:31.570094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.617750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:31.618779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:31.625278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:31.625788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:31.626215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.626936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:31.627383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:31.627800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:31.699912 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:31.707618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-405c5fe7-45af-4b26-a5e7-30c3210edff8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1682 microversion: 2.1 time: 0.150919 Oct 17 10:32:31.708404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 410/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:31 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:31.760781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:31.768642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-204ea1c5-007f-4d92-b8df-8bb304b07843 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.155813 Oct 17 10:32:31.769205 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 431/841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:31 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:32.140175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:32.140782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:32.146935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.147412 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.147846 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.148527 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.148977 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.149389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.387823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:32.395819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:32.397279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:32.398610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-eb750b2b-5f23-4c52-9ad5-d35d82e87b33 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.262129 Oct 17 10:32:32.398981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 411/842] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:32 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:32.731386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:32.731991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:32.738268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.738777 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.739207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.739886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.740331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.740744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.793408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:32.794015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:32.800213 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.800665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.801096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.801793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:32.802242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:32.802688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:32.879232 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:32.887326 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-60425358-26b9-4749-b6e6-4bc6125851d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1682 microversion: 2.1 time: 0.160583 Oct 17 10:32:32.887893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 432/843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:32 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:32.969946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:32.978489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d261b40e-4d6c-4f1b-b821-161c7c8c740e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.189481 Oct 17 10:32:32.979055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 412/844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:32 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:33.423695 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:33.424305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:33.430842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:33.431323 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:33.431762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:33.432454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:33.432910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:33.433330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:33.563065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:33.571923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:33.573366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:33.574525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ee289a47-fede-4433-8eed-493f724f58f1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1407 microversion: 2.20 time: 0.154760 Oct 17 10:32:33.575095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 433/845] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:33 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:33.911191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:33.911722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:33.919061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:33.919542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:33.919974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:33.920658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:33.921297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:33.921720 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:33.940729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:34.002037 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:34.002660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:34.009069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:34.009407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.009897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.010357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.011227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.011677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.012092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.016937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0afc7b7b-78c3-409f-bdbb-c266f41340df tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1614 microversion: 2.1 time: 0.109590 Oct 17 10:32:34.017601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 413/846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:33 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:34.087309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72c375f-ee9a-4b63-acc8-a2ac6bc2240d", "name": "network-vif-deleted", "tag": "a4988059-c6df-4884-b84c-2138e3c60d51"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:34.097485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.098181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.098413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.121364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] Creating event network-vif-deleted:a4988059-c6df-4884-b84c-2138e3c60d51 for instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d on hv-cinder-86020 Oct 17 10:32:34.126499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-5e3c8fda-cf82-4da8-8f03-73a0a8c21f69 req-8b5427d9-fcd4-4869-ab2a-bfc8286db443 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046046 Oct 17 10:32:34.127414 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 414/847] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:32:34.172706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:34.181732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b056b934-c27d-4cbf-a9bf-df112c6cd4f7 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.183271 Oct 17 10:32:34.183149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 434/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:33 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:34.600138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:34.600955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:34.607536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.608035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.608477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.609179 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.609639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.610070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.740807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:34.749971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:34.751110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:34.752275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-15a4ee12-1538-4446-82ed-d7205a846e24 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1599 microversion: 2.20 time: 0.156595 Oct 17 10:32:34.752887 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 415/849] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:32:34 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:32:34.778141 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:34.778670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:34.784770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.785261 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.785726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.786510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:34.786876 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:34.787295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:34.876499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2c68b83b-36e6-4de6-95ff-f03de8c8fce7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103165 Oct 17 10:32:34.877255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 435/850] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 17 10:32:34 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:32:35.042270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:35.043582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:35.051168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:35.051878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:35.052509 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:35.053642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:35.055824 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:35.056630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:35.103178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:35.103178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:35.103532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:35.104172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'fault' on Instance uuid b72c375f-ee9a-4b63-acc8-a2ac6bc2240d {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:32:35.181646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:35.189698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e4044575-20f7-4994-9a65-a8a94dfc2315 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 200 len: 1331 microversion: 2.1 time: 0.152653 Oct 17 10:32:35.194416 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 416/851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:35 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 1331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:35.207508 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:35.208150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:35.215022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:35.215597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:35.216251 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:35.217105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:35.217726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:35.218308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:35.358691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:35.367784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-65309f3c-1e7d-4d6d-b932-14bb0ec470be tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.164123 Oct 17 10:32:35.368932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 436/852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:35 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:36.187275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:36.197115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:36.197594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:36.198032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:36.209138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] Creating event network-changed:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:32:36.214607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-4e0de1aa-2866-4a8d-88df-9e0f5120e8ae req-ab3f54ef-dc1d-4b3a-a849-82c722b5146b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030856 Oct 17 10:32:36.214980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:36.215603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:36.217594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 417/853] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:36.222172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:36.222708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:36.223144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:36.223840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:36.224293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:36.224714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:36.239896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d HTTP/1.1 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:32:36.241598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:32:36.243983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'b72c375f-ee9a-4b63-acc8-a2ac6bc2240d'} Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:32:36.245118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:32:36.246929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:32:36.248454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:32:36.248454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b4a978a8-85b3-46d2-9519-b48217941076 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 404 len: 111 microversion: 2.1 time: 0.032692 Oct 17 10:32:36.248454 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 437/854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:36 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:32:36.254511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-73d8c15a-5ec3-4a3d-8659-400112a38b68 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '.version_select at 0x7fe9ba567e50>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:36.267745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:36.277270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-73d8c15a-5ec3-4a3d-8659-400112a38b68 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694988136" status: 202 len: 0 microversion: 2.1 time: 0.027000 Oct 17 10:32:36.277865 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 418/855] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 10:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694988136 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:32:36.392840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:36.393906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:36.401202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:36.402005 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:36.402672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:36.403599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:36.404248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:36.404870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:36.584484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:36.594195 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2d594b5b-f977-4d25-8924-664ec81a2696 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.205224 Oct 17 10:32:36.594803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 438/856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:36 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:37.230273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d2f5455a-d382-47cd-a275-00aff5192c2d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: .version_select at 0x7fe9ba7b20d0>, body: {"keypair": {"name": "tempest-keypair-166359474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrpqSj6Bv9X8jnW0+TQfFnmbFhqgoqIToJuhi+v/L1bxNPV0E5NXxDotaJ+MbtoTqabkw5dPMj+i5raZkOs+XaAm2uDo1NyrcJ3VwYlUw4Q1LJLWoAva0RBEZ/WiIBCJg=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:37.249722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-d2f5455a-d382-47cd-a275-00aff5192c2d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:37.254813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-d2f5455a-d382-47cd-a275-00aff5192c2d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:37.278657 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d2f5455a-d382-47cd-a275-00aff5192c2d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053895 Oct 17 10:32:37.279256 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 419/857] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 17 10:32:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:37.620004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:37.620763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:37.627043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:37.627523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:37.627957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:37.628655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:37.629109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:37.629530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:37.781276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:37.790276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5023f0c0-ba29-440a-b1dd-3fd7117f04ba tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.174468 Oct 17 10:32:37.790966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 439/858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:37 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:38.594260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-970487830", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad62b422-f6a9-44d6-866f-37a78f2fcbac"}], "security_groups": [{"name": "tempest-securitygroup--2073760049"}], "key_name": "tempest-keypair-166359474", "user_data": "}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:38.702237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] validate_networks() for [('ad62b422-f6a9-44d6-866f-37a78f2fcbac', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:32:38.814061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:38.814775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:38.822411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:38.822908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:38.823371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:38.824120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:38.824571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:38.824993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:38.957148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:38.965325 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1cfdff9d-e97f-4359-b097-2bbefaaaf649 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.155288 Oct 17 10:32:38.966006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 440/859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:38 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:39.074485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:32:39.074915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:32:39.075383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:32:39.075787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:32:39.076194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:32:39.084957 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:39.085444 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:39.085870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:39.086707 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:39.087168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:39.087588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:39.104818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:32:39.108776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Getting quotas for user 6b4b2700c20946ea93a1d20d7dea929f and project 41a236cfbaf14211a6a3674f3c2f3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:32:39.120480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:32:39.123025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:32:39.169699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3ef37aa1-b228-4741-b01d-283b0a3fd722 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579675 Oct 17 10:32:39.170356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 420/860] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:32:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:32:39.181472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cd615925-7b11-49d9-8c68-dfa12998cb51 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:39.182086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cd615925-7b11-49d9-8c68-dfa12998cb51 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:39.234910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cd615925-7b11-49d9-8c68-dfa12998cb51 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:39.241734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cd615925-7b11-49d9-8c68-dfa12998cb51 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1240 microversion: 2.1 time: 0.064142 Oct 17 10:32:39.242299 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 441/861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:39 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:39.989210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:39.989789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:39.997476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:39.997971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:39.998450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:39.999143 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:39.999604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:40.000031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:40.135290 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:40.143038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3a1c6f8a-5a9b-46e2-8222-77d89908ddd8 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.158316 Oct 17 10:32:40.143620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 421/862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:39 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:40.264126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:40.264746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:40.271161 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:40.271648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:40.272086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:40.272776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:40.273899 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:40.274356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:40.339941 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:40.347944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-664b353f-d7ce-475b-9ff8-14bce205cd37 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1292 microversion: 2.1 time: 0.087681 Oct 17 10:32:40.348502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 442/863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:40 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:41.167087 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:41.167692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:41.174067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:41.174560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:41.174990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:41.175670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:41.176152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:41.176572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:41.313272 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:41.321555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f1c368ec-c6ae-4e50-965c-a3286224d41c tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.158744 Oct 17 10:32:41.322121 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 422/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:41 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:41.372758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:41.373362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:41.379712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:41.380190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:41.380624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:41.381300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:41.381752 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:41.382244 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:41.448290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:41.455861 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d42785b0-60ba-46a7-af85-acf1038eef0f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1292 microversion: 2.1 time: 0.087063 Oct 17 10:32:41.456415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 443/865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:41 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:42.345378 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:42.346165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:42.353021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:42.353778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:42.354214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:42.355223 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:42.355676 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:42.356086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:42.478957 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:42.479830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:42.486809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:42.487300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:42.488102 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:42.489048 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:42.490660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:42.491309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:42.618498 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:42.626911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3f99353f-b94c-4586-806a-07951df495a5 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.285860 Oct 17 10:32:42.627490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 423/866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:42 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:42.629668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:42.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d5364cfa-a3c2-4458-8138-7425586f05d3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.162517 Oct 17 10:32:42.638406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 444/867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:42 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:43.049198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5861a58c-cacd-4d21-98ba-c8e7c3035149", "tag": "b03fee14-0c20-4138-b286-c5ef934ceb22"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:43.060999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:43.061476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:43.061905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:43.073366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] Creating event network-changed:b03fee14-0c20-4138-b286-c5ef934ceb22 for instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 on hv-cinder-86020 Oct 17 10:32:43.078419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-7d396a89-cddc-42d0-8273-e30a5ceb28e8 req-ef1660cf-1c45-44d1-b5df-07b1e16d7ff3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034039 Oct 17 10:32:43.087055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 424/868] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:32:43.651393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:43.651942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:43.658343 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:43.658833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:43.659266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:43.659960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:43.660693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:43.661142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:43.663135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:43.663884 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:43.669883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:43.670397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:43.670830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:43.671516 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:43.671965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:43.672384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:43.796444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:43.804332 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e698e74e-b363-4b82-b9b8-87f135cab6c9 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.157355 Oct 17 10:32:43.804823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 445/869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:43 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:43.810127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:43.817826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5c139070-a5e0-43c0-b9ad-b04e2e86630c tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.159784 Oct 17 10:32:43.818407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 425/870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:43 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:44.828084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:44.828691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:44.835097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:44.836499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:44.837348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:44.838627 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:44.839176 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:44.839637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:44.841275 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:44.841940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:44.848739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:44.849229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:44.849670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:44.850447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:44.851516 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:44.851966 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:44.982708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:44.990778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f5480e34-f422-405f-8c83-a472dffa142e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.166446 Oct 17 10:32:44.991364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 446/871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:44 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:45.127195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:45.135329 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b9075cc8-37d0-4e54-aebc-6c5a35f02dc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.298171 Oct 17 10:32:45.135894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 426/872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:44 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:45.436766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "name": "network-vif-plugged", "status": "completed", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:45.448912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:45.449405 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:45.449833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:45.461418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] Creating event network-vif-plugged:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:32:45.466705 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-98cd362c-9abb-4bab-a511-71538c062775 req-032d45e3-8f25-4bc6-bbc8-bb52ea792d11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Oct 17 10:32:45.467331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 447/873] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:46.015985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:46.016630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:46.023032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:46.023523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:46.024058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:46.024787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:46.025242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:46.025668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:46.159177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:46.159870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:46.168189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:46.168951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:46.169556 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:46.170461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:46.171067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:46.171643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:46.196766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:46.265316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:46.287466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c8d030f2-594b-44f0-92c6-862a8523bfcf tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.275241 Oct 17 10:32:46.289029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 427/874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:46 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:46.328748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:46.339762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-43a1e01d-3f55-427c-bcc0-f9becf45f409 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.184379 Oct 17 10:32:46.340535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 448/875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:46 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:47.311201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:47.311812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:47.318111 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:47.318629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:47.319063 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:47.319764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:47.320218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:47.320638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:47.363585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:47.364895 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:47.368091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:47.374242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:47.374877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:47.375307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:47.376006 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:47.376640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:47.377066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:47.534364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:47.544230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5f543f78-0ccd-4561-97d0-d9c2c9cb0d56 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.184433 Oct 17 10:32:47.544820 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 449/876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:47 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:47.819195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:47.827044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c4ce595b-5740-4b9a-bb54-e238f49cf23e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1576 microversion: 2.1 time: 0.519701 Oct 17 10:32:47.827607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 428/877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:47 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1576 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:48.565975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:48.566680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:48.573788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:48.574264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:48.574719 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:48.575402 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:48.575847 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:48.576265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:48.704109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:48.711867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6a34485d-6862-4261-a879-896db26c15a8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.149700 Oct 17 10:32:48.712439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 450/878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:48 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:48.851441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:48.852007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:48.858755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:48.859262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:48.859682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:48.860388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:48.860834 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:48.861263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:48.990921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:48.999284 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f3882569-acb5-4f83-b5fe-8b4087890492 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1563 microversion: 2.1 time: 0.152303 Oct 17 10:32:48.999843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 429/879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:48 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:49.452615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5861a58c-cacd-4d21-98ba-c8e7c3035149", "name": "network-vif-plugged", "status": "completed", "tag": "b03fee14-0c20-4138-b286-c5ef934ceb22"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:49.457900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:49.464832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:49.465311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:49.465945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:49.482207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] Creating event network-vif-plugged:b03fee14-0c20-4138-b286-c5ef934ceb22 for instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 on hv-cinder-86020 Oct 17 10:32:49.487252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-109cff1e-1811-4630-b775-6878578e9810 req-cb4d3d70-3f1b-4658-b723-654ed5e235cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038668 Oct 17 10:32:49.488014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 451/880] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:49.740074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:49.740561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:49.743315 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:49.744120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=10 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:32:49.750462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:49.751009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:49.751477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:49.752168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:49.752622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:49.753041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:49.941574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:49.949883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1887a5d3-1557-4b81-a5a7-8a2241c28262 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.214013 Oct 17 10:32:49.950502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 430/881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:49 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:50.972937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:50.973668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:50.980858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:50.981358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:50.981792 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:50.982514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:50.982971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:50.983397 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:51.120300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:51.129188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8fb0f015-3c6d-4048-b223-91df23a5fbc1 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1366 microversion: 2.1 time: 0.161031 Oct 17 10:32:51.129766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 452/882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:50 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:32:52.152847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:52.153481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:52.159934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:52.160419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:52.160858 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:52.161547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:52.162007 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:52.162462 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:52.300787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:32:52.308931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aa8a8ba5-faaa-46aa-a46f-4ffba8485801 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1556 microversion: 2.1 time: 0.159975 Oct 17 10:32:52.309521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 431/883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:32:52 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:32:52.331529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:32:52.332033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:32:52.338440 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:52.338954 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:52.339392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:52.340081 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:52.340534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:52.340956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:52.419817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-63cd276b-f580-4fb3-a07e-33fc8bfda9d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091960 Oct 17 10:32:52.420302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 453/884] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 17 10:32:52 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:32:53.356393 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5861a58c-cacd-4d21-98ba-c8e7c3035149", "tag": "b03fee14-0c20-4138-b286-c5ef934ceb22"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:32:53.366885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:32:53.367518 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:32:53.367974 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:32:53.381008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] Creating event network-changed:b03fee14-0c20-4138-b286-c5ef934ceb22 for instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 on hv-cinder-86020 Oct 17 10:32:53.386626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-4888af47-d772-4c92-872c-b96cdebb9964 req-44cdacca-2c1a-4765-af4a-74c88ed02815 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Oct 17 10:32:53.387218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 432/885] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:33:24.128892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=9 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:24.129686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=26 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:24.134178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-556676978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785350402", "security_groups": [{"name": "tempest-secgroup-smoke-1119150375"}], "block_device_mapping_v2": [{"uuid": "816c3a1b-7b26-4c93-87d5-660d2e2bec3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e6600083-efa1-4cdc-8469-423af4747abb"}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:33:24.245260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] validate_networks() for [('e6600083-efa1-4cdc-8469-423af4747abb', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:33:24.861987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:33:24.862464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:33:24.862936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:33:24.863341 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:33:24.863749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:33:24.872304 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:24.872785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:24.873220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:24.873945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:24.874432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:24.874874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:24.892298 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:33:24.896472 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Getting quotas for user a5b7190649694b9882ab34c0f3114a3e and project 0e87741d68c74ae29ecea930893e3449. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:33:24.952110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:33:24.954903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='816c3a1b-7b26-4c93-87d5-660d2e2bec3a',volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:33:25.081168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-713207f2-43a5-44f2-a588-9dc6d58181fc tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.953975 Oct 17 10:33:25.082368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 454/886] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:33:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:33:25.091208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:25.092400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=86 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:25.097941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7f67cb78-6046-4af2-bf56-5a7f587e31d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:25.098722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7f67cb78-6046-4af2-bf56-5a7f587e31d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:25.160637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7f67cb78-6046-4af2-bf56-5a7f587e31d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:25.168445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7f67cb78-6046-4af2-bf56-5a7f587e31d5 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1093 microversion: 2.1 time: 0.079307 Oct 17 10:33:25.169023 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 433/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:25 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:33:26.192342 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:26.192904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:26.199475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:26.199956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:26.200385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:26.201067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:26.201516 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:26.201932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:26.265971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:26.274393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-752ddb2e-1b9a-4a20-89ea-95a94cc36a9f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1191 microversion: 2.1 time: 0.087530 Oct 17 10:33:26.274953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 455/888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:26 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:27.297046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:27.297665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:27.304343 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:27.304839 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:27.305280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:27.305991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:27.306483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:27.306913 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:27.499728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:27.508132 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f46c83fe-35bb-46ba-ac89-cc10be23cefe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.214965 Oct 17 10:33:27.509380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 434/889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:27 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:27.782275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10f389b-b9a0-4b8c-8d62-d4d3032b267d", "tag": "4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:33:27.792925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:27.794061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:27.794575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:27.807280 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] Creating event network-changed:4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b for instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d on hv-cinder-86020 Oct 17 10:33:27.812166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-e1c54f9e-c92b-482b-b69b-94ee3b471a30 req-542539c2-e671-40df-8b88-37ab5e4b4620 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Oct 17 10:33:27.812924 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 456/890] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:33:28.531517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:28.532126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:28.539602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:28.540085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:28.540521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:28.541207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:28.541663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:28.542117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:28.672868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:28.681891 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fb9911e2-1f4c-4359-ad50-0bb741c26d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.154186 Oct 17 10:33:28.682495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 435/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:28 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:29.706399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:29.707108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:29.713530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:29.714027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:29.714497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:29.715209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:29.715669 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:29.716089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:29.856581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:29.865231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-87d7cc15-8f0d-48d8-9243-0bbdcd12fd17 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.163887 Oct 17 10:33:29.865822 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 457/892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:29 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:30.887469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:30.888101 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:30.895756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:30.896241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:30.896677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:30.897441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:30.897997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:30.898443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:31.031473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:31.041355 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-77e5ed46-8db6-4c41-bf85-1344d21fa391 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.157675 Oct 17 10:33:31.041935 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 436/893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:30 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:32.065147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:32.065711 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:32.072363 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:32.072857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:32.073295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:32.074003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:32.074498 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:32.074935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:32.203641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:32.211316 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-244040b7-a77d-4902-9c5f-b339df73c81b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.150774 Oct 17 10:33:32.211886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 458/894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:32 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:33.233741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:33.234372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:33.241468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:33.241959 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:33.242424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:33.243119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:33.243575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:33.244001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:33.371316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:33.379050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cf1b2ac3-e9ce-4a79-9f7d-3c7dc987cffe tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.149354 Oct 17 10:33:33.379620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 437/895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:33 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:34.401867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:34.402480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:34.408878 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:34.409447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:34.409882 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:34.410600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:34.411057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:34.411482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:34.544476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:34.552667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1128d4bb-aaed-4700-814c-d8a3fbd92b81 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.155077 Oct 17 10:33:34.553229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 459/896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:34 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:35.576047 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:35.576680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:35.579024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:35.585363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:35.585843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:35.586307 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:35.587012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:35.587466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:35.587889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:35.721431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:35.729105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7a3fb644-a1b5-4e1d-ac1d-6653e795413d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.156901 Oct 17 10:33:35.729934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 438/897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:35 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:36.753415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:36.754051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:36.756026 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:36.756717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:33:36.762973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:36.763453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:36.763881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:36.764566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:36.765013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:36.765426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:36.904035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:36.912335 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-266a29c6-464b-4758-9a8f-0425a6d93c4c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.163965 Oct 17 10:33:36.912907 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 460/898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:36 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:37.935493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:37.936028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:37.943278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:37.943789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:37.944269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:37.945011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:37.945473 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:37.945901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:38.081747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:38.089522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b7148610-665f-4a58-b796-8aa80d0202b8 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.157959 Oct 17 10:33:38.090080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 439/899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:37 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:33:39.112825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:39.113460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:39.119829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:39.120309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:39.120744 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:39.121431 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:39.121995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:39.122308 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:39.253995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:39.261747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f5f5395a-2696-41fc-8e4a-9f2a4ee4e59a tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.153435 Oct 17 10:33:39.262312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 461/900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:39 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:39.710518 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10f389b-b9a0-4b8c-8d62-d4d3032b267d", "name": "network-vif-plugged", "status": "completed", "tag": "4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:33:39.722115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:39.722703 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:39.723289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:39.734799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] Creating event network-vif-plugged:4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b for instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d on hv-cinder-86020 Oct 17 10:33:39.739810 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-2e7e4b17-e9ad-4e27-8347-db8d2d51f894 req-04438ba4-17b8-4bfa-ae41-2435f744182c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 Oct 17 10:33:39.740568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 440/901] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:33:40.284966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:40.285536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:40.292011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:40.292497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:40.293127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:40.293836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:40.294916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:40.294916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:40.425283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:40.433038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-91ae9646-6430-49c5-832e-9277214bc0df tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.152907 Oct 17 10:33:40.433600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 462/902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:40 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:41.456437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:41.457043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:41.463699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:41.464175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:41.464607 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:41.465291 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:41.465752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:41.466173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:41.593572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:41.601135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aa600579-05db-45d7-9d8a-3b2f33d01d0c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1265 microversion: 2.1 time: 0.149566 Oct 17 10:33:41.601694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 441/903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:41 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:33:42.623549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:42.624162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:42.630807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:42.631290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:42.631724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:42.632416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:42.632871 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:42.633297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:42.760707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:42.768919 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-688d9c80-bad8-4322-bd87-11cae6c6476d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1452 microversion: 2.1 time: 0.149212 Oct 17 10:33:42.769489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 463/904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:42 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:42.797388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:33:42.798033 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:33:42.804463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:42.804944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:42.805377 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:42.806060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:42.806615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:42.807036 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:42.942883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:33:42.950517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-51fdfb4c-c05d-4351-9b7b-e72ab83c981d tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1452 microversion: 2.1 time: 0.156934 Oct 17 10:33:42.951074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 442/905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:33:42 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:33:44.661499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10f389b-b9a0-4b8c-8d62-d4d3032b267d", "tag": "4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:33:44.671530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:33:44.672042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:33:44.672496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:33:44.685989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] Creating event network-changed:4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b for instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d on hv-cinder-86020 Oct 17 10:33:44.690992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-c93c4233-ddf5-4d01-858f-f1d142ca3b46 req-fa7ec42e-f087-45a0-8293-73780ab87f06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033910 Oct 17 10:33:44.691913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 464/906] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:05.609955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:05.610561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:05.613464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=22 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:05.614130 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=50 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:05.620287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:05.620770 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:05.621203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:05.621890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:05.622390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:05.622814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:05.645538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-602f14df-5307-437b-9c7f-a7aa1303a4ce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/ips" status: 200 len: 146 microversion: 2.1 time: 0.039383 Oct 17 10:34:05.646090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 443/907] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:34:05 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:08.057453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:08.058194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=54 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:08.063009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "680d247f-5411-4638-b5ca-b4c1efc00f77"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:08.065490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:08.073057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:08.073549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:08.073988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:08.074714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:08.075174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:08.075599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:08.491025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-820837b4-9e17-4485-9a4a-36419802b2d6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434990 Oct 17 10:34:08.491632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 465/908] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:34:08 2022] POST /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:34:15.750000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:15.750660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:15.752960 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.753701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:15.759592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:15.760073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:15.760503 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:15.761196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:15.761649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:15.762075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:15.788152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dd401c6d-807e-45f2-ac9c-08321625c007 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/ips" status: 200 len: 151 microversion: 2.20 time: 0.041989 Oct 17 10:34:15.788732 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 444/909] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 17 10:34:15 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:34:16.034136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:16.036527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:16.042906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:16.043418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:16.043944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:16.044650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:16.045133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:16.045567 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:16.082423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c0a3fcd2-60e2-4c05-932c-fc8737280dce tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052053 Oct 17 10:34:16.083556 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 466/910] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:16 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:16.094055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:16.094739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:16.100866 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:16.101370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:16.101785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:16.103821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:16.105257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:16.106009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:16.137164 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-67f0833a-2a2c-4405-9066-d69870109978 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77" status: 200 len: 194 microversion: 2.1 time: 0.046958 Oct 17 10:34:16.137775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 445/911] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 10:34:16 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:17.668030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:17.668627 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:17.675018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:17.675448 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:17.675881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:17.676564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:17.677016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:17.677437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:17.699383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lazy-loading 'flavor' on Instance uuid 239b5400-d752-426a-a5f1-fe0746c3e990 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:17.890644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8111fce9-1101-4586-bf0f-217d70124b68 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/action" status: 202 len: 0 microversion: 2.20 time: 0.226279 Oct 17 10:34:17.891229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 467/912] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 10:34:17 2022] POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:34:17.900096 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:17.900800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:17.907142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:17.907631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:17.908067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:17.908767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:17.909267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:17.909645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:18.041803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:18.049796 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:18.051434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:18.052590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6ce5327b-868e-436e-b1be-68d3bfeb534c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.156492 Oct 17 10:34:18.053172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 446/913] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:17 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:34:18.532843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d421bedd-8908-492d-ae33-0638a65a012d"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:18.535964 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:18.543052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:18.543533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:18.543963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:18.544649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:18.545098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:18.545514 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:18.807282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8daaf0d5-0d08-42d1-a30b-7fc13332d8bd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "POST /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279159 Oct 17 10:34:18.807925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 468/914] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:34:18 2022] POST /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:19.077845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:19.078496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:19.086004 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:19.086538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:19.086981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:19.087684 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:19.088145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:19.088576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:19.219377 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:19.227616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:19.229061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:19.230515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b1496949-06f8-4077-a9b6-2e216dea3f6e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.156576 Oct 17 10:34:19.231076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 447/915] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:19 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:20.257384 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:20.258087 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:20.264283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:20.264766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:20.265201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:20.265886 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:20.266362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:20.266780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:20.403226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:20.411201 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:20.412645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:20.413801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-49c7a023-81c1-4ae3-a950-035b2052e2ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.161250 Oct 17 10:34:20.414376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 469/916] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:20 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:21.438712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:21.439321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:21.445389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:21.445872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:21.446305 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:21.447039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:21.447495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:21.447917 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:21.575980 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:21.584788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:21.586231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:21.587420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a2d65cee-eb97-4dc1-a74c-a84cfaf0599a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.152684 Oct 17 10:34:21.587988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 448/917] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:21 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:22.613361 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:22.614424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:22.620795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:22.621271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:22.621697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:22.622407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:22.622855 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:22.623271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:22.749640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:22.758714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:22.760137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:22.761281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-efbf9bc6-32f7-4986-b07d-409602d9712f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.151847 Oct 17 10:34:22.761828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 470/918] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:22 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:23.788265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:23.788868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:23.795215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:23.795689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:23.796120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:23.796803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:23.797259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:23.797677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:23.926546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:23.934822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:23.936288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:23.937436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-87bfd1ef-de92-4747-807a-ae69fb6147ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.153968 Oct 17 10:34:23.937982 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 449/919] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:23 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:24.963499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:24.964095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:24.970475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:24.970951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:24.971380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:24.972072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:24.972518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:24.972937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:25.107333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:25.115322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:25.116833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:25.117974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7dcfb376-b25c-424a-9514-9e1390aaf238 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.159011 Oct 17 10:34:25.118577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 471/920] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:24 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:26.143758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:26.144381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:26.151972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.152455 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.152886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.153575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.154029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.154486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.293734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:26.302061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:26.304266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:26.305492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-888a9518-e0f4-487c-8f42-62769021dd48 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.165917 Oct 17 10:34:26.306044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 450/921] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:26 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:26.341986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:26.344238 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:26.351074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.351568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.352013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.352749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.353212 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.353644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.384969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-adc77497-c619-48f7-beb3-e2792ae337fb tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046804 Oct 17 10:34:26.385520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 472/922] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:26 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:26.528663 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:26.529151 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:26.535199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.535735 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.536127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.536922 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.537321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.537747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.565573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-24f32507-ebe6-4232-a8e5-5434956cba62 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77" status: 200 len: 194 microversion: 2.1 time: 0.041032 Oct 17 10:34:26.566137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 451/923] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 10:34:26 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:26.577154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:26.577644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:26.583542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.584658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.585097 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.585781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:26.586234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:26.586686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:26.665328 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lazy-loading 'services' on Instance uuid f0213217-d654-40f4-a65f-0515383c1b09 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:26.735056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d15c77ba-e861-41d6-8a4d-a37c4e5dce9c tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77" status: 202 len: 0 microversion: 2.1 time: 0.161560 Oct 17 10:34:26.735588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 473/924] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:34:26 2022] DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/680d247f-5411-4638-b5ca-b4c1efc00f77 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:34:27.331450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:27.332025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:27.339101 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:27.339604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:27.340022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:27.340713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:27.341201 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:27.341654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:27.471965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:27.481442 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:27.482938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:27.484088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-08442376-f8f5-4725-8f03-507edf71aa2a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.156656 Oct 17 10:34:27.484639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 452/925] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:27 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:28.510489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:28.511190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:28.517293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.517781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.518223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:28.518946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.519404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.519831 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:28.649175 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:28.657100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:28.658573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:28.659726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b927e85c-bd77-42bc-9c57-ca376c5ac6e7 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.154538 Oct 17 10:34:28.660274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 474/926] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:28 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:28.913739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:28.914240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:28.920875 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.921369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.921801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:28.922543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.922992 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.923420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:28.952677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-15a9b8c5-b3aa-40b0-9830-3c99a3a471c6 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/d421bedd-8908-492d-ae33-0638a65a012d" status: 200 len: 194 microversion: 2.1 time: 0.042920 Oct 17 10:34:28.953247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 453/927] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 17 10:34:28 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/d421bedd-8908-492d-ae33-0638a65a012d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:28.964136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:28.964657 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:28.970581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.971064 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.971498 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:28.972188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:28.972641 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:28.973060 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:29.051787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lazy-loading 'services' on Instance uuid f0213217-d654-40f4-a65f-0515383c1b09 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:29.055808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:29.122722 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ea0eb9eb-7276-47d8-aa67-f9d5a1e25ecd tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/d421bedd-8908-492d-ae33-0638a65a012d" status: 202 len: 0 microversion: 2.1 time: 0.162316 Oct 17 10:34:29.123376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 475/928] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:34:28 2022] DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments/d421bedd-8908-492d-ae33-0638a65a012d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:34:29.684975 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:29.685588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:29.691577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:29.692057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:29.692490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:29.693833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:29.694289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:29.694756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:29.824780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:29.833139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:29.834624 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:29.835793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e0588489-95d2-486b-8adc-db03bfede6e5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.154817 Oct 17 10:34:29.836351 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 454/929] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:29 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:30.304943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:30.307508 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:30.313828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.314311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.314770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.315469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.315925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.316353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.347724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-12c2b4b0-4e88-4519-a662-f7e600f072e8 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048796 Oct 17 10:34:30.348281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 476/930] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:30 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:34:30.463824 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:30.466041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:30.472354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.472843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.473282 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.473976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.474616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.475039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.503949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e3c82026-b2dd-4641-a115-1478b7a19984 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044004 Oct 17 10:34:30.504499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 455/931] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:30 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:34:30.569845 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:30.570365 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:30.576394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.576914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.577404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.578123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.578613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.579039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.604227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:34:30.679194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d49469da-49ef-49c2-bbb5-d2a6366df936 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 204 len: 0 microversion: 2.1 time: 0.113524 Oct 17 10:34:30.679770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 477/932] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:30 2022] DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:34:30.689379 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:30.689953 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:30.697233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.697689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.698127 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.698838 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.699293 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.699714 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.828763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:30.836497 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c2f7fdda-cd0d-4676-812d-c7fbd530e4db tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1675 microversion: 2.1 time: 0.150998 Oct 17 10:34:30.837060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 456/933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:30 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:30.861756 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:30.862480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:30.869109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.869594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.870039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:30.870819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:30.871273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:30.871692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:31.002569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:31.010692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:31.012138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:31.013290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d0abb3f2-cd7f-4f71-87d2-a39ec930c9a5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.155791 Oct 17 10:34:31.013842 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 478/934] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:30 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:31.861129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:31.861776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:31.870276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:31.870958 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:31.871409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:31.872120 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:31.872586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:31.873015 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:32.012267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:32.020468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fa2d3edf-29f5-41c1-b88c-a0600bde8cef tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1675 microversion: 2.1 time: 0.163978 Oct 17 10:34:32.021656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 457/935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:31 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:32.039137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:32.039833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:32.049838 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:32.051970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:32.052995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:32.053784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:32.054247 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:32.054834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:32.192622 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:32.201268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:32.202873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:32.204027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4aceb087-6295-493a-8b9e-68f020b5cf70 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.169699 Oct 17 10:34:32.204573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 479/936] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:32 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:33.044130 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:33.044740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:33.051097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:33.051582 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:33.052022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:33.052726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:33.053185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:33.053609 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:33.230021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:33.230677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:33.237419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:33.237913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:33.238370 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:33.239083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:33.239542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:33.240603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:33.374317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:33.382893 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:33.384334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:33.385544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-173a6442-d8bc-4113-b003-6930766feef2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.159796 Oct 17 10:34:33.386094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 480/937] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:33 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:34:33.478626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:33.486502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0c23b837-0a23-44e2-8a4e-a5c3f0c906ad tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1675 microversion: 2.1 time: 0.446193 Oct 17 10:34:33.487241 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 458/938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:33 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:34.181563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0213217-d654-40f4-a65f-0515383c1b09", "name": "network-vif-deleted", "tag": "234eeab0-608b-4862-ba56-6aedf471e915"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:34.191715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.192217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.192617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.204231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] Creating event network-vif-deleted:234eeab0-608b-4862-ba56-6aedf471e915 for instance f0213217-d654-40f4-a65f-0515383c1b09 on hv-cinder-86020 Oct 17 10:34:34.210339 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-fd4ef5f1-7186-4030-80e0-17b72b20a665 req-d86c21d7-f4c4-4f2b-a952-0eef21dc06b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032882 Oct 17 10:34:34.211571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 481/939] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:34.285039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:34.286316 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:34.297258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.300188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.301025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.302067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.303470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.305559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.336936 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6c5d4d17-0595-4fd3-b61f-0766906793e8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/ips" status: 200 len: 150 microversion: 2.1 time: 0.057461 Oct 17 10:34:34.337524 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 459/940] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:34:34 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:34.413124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:34.414220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:34.424122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.424619 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.425054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.426655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.428303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.429540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.515158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:34.516500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:34.525347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.526081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.527118 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.528261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.529738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.530362 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.586438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:34.587293 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:34.587893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:34.588502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lazy-loading 'fault' on Instance uuid f0213217-d654-40f4-a65f-0515383c1b09 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:34.634259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:34.636590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c6da9fd3c4b72a687daa923d07918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad3932c3fcc4d42b77b26f889ac694f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:34.640603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=100 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:34.645317 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:34.647279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:34.648878 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-850b6eb2-2b12-4e57-980a-1eaeee2d4c25 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.241238 Oct 17 10:34:34.649893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c235ad25-1bd6-4c64-8635-d37a56c6409b tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 200 len: 1328 microversion: 2.1 time: 0.143241 Oct 17 10:34:34.650598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 482/941] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:34 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:34:34.650815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 460/942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:34 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 1328 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:34:35.675286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:35.676012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:35.676412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:35.677541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:35.682955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.683383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.683818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.684056 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.684512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.684625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.685019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.685147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.685382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.685656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.686113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.686564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.700260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 HTTP/1.1 Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:35.702084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:35.703723 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'f0213217-d654-40f4-a65f-0515383c1b09'} Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:35.704623 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:35.706233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:35.708297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:35.708297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-33f01d22-9e14-4981-84a2-eaa372f01ac4 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 404 len: 111 microversion: 2.1 time: 0.032650 Oct 17 10:34:35.708297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 461/943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:35 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:35.712600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a974b225-8c46-47d5-954c-32636ab27725 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '.version_select at 0x7fe9ba63cc10>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:35.732262 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a974b225-8c46-47d5-954c-32636ab27725 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650359443" status: 202 len: 0 microversion: 2.1 time: 0.023473 Oct 17 10:34:35.732841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 462/944] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 17 10:34:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650359443 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:34:35.837098 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e67e2e06-016c-42a6-b9cb-46a20cee81a2"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:35.839789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:35.847594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.848614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.849649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.850939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:35.852278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:35.852883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:35.948078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:35.959071 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:35.960536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:35.961716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-09f24c28-b6cb-4cdc-af60-27f11deea9a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1744 microversion: 2.20 time: 0.289295 Oct 17 10:34:35.980603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 483/945] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:35 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:36.178090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-401e2ce4-17b5-4905-8b2b-b4084ca0a691 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "POST /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347686 Oct 17 10:34:36.178763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 463/946] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:34:35 2022] POST /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:34:36.988416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:36.989012 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:36.996338 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:36.996824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:36.997255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:36.997969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:36.998451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:36.998876 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:37.131733 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:37.140118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:37.141559 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:37.142821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ad2d2915-0976-4062-a937-bb9bcff27a22 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1744 microversion: 2.20 time: 0.158295 Oct 17 10:34:37.143381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 484/947] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:36 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:38.044997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "name": "network-vif-plugged", "status": "completed", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:38.055961 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.056512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.056944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.068517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] Creating event network-vif-plugged:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:34:38.073517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-aae1aef3-dc6b-42d0-b9ca-ecb18b23b0ad req-c138a901-28fd-49aa-8130-a71fae000099 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Oct 17 10:34:38.074440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 464/948] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:38.169542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:38.170168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:38.172611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:38.178465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.178958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.179398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.180092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.180552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.180979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.316694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:38.325770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:38.327344 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:38.328491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c44f5525-8db9-4b7f-ac8e-bfeb4baba04b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1744 microversion: 2.20 time: 0.163594 Oct 17 10:34:38.329214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 485/949] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:38 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:38.761474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:38.762052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:38.768589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.769074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.769506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.770186 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.770673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.771165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.785634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 HTTP/1.1 Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:38.787581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.789274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'f0213217-d654-40f4-a65f-0515383c1b09'} Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:38.790288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.791650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.793402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:38.793402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-48c50291-6ab7-4d99-a222-bf9161107674 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 404 len: 111 microversion: 2.1 time: 0.031897 Oct 17 10:34:38.793402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 465/950] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:38 2022] DELETE /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:34:38.797258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:38.797868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: f0213217-d654-40f4-a65f-0515383c1b09] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:38.804590 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.805080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.805516 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.806204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:38.806692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:38.807116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:38.820667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 HTTP/1.1 Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:38.822278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.823927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'f0213217-d654-40f4-a65f-0515383c1b09'} Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:38.824992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. Oct 17 10:34:38.826503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:38.827937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance f0213217-d654-40f4-a65f-0515383c1b09 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:38.827937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-340227d3-4ce5-45cb-a391-4e44beeee356 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09" status: 404 len: 111 microversion: 2.1 time: 0.030226 Oct 17 10:34:38.827937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 486/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:38 2022] GET /compute/v2.1/servers/f0213217-d654-40f4-a65f-0515383c1b09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:39.355727 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:39.356276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:39.363225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:39.363762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:39.364369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:39.365178 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:39.365604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:39.366182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:39.558879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:39.568683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:39.570220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:39.571447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-66cefa8c-d776-4a6d-b4d7-21e99fec8e7b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1744 microversion: 2.20 time: 0.220139 Oct 17 10:34:39.572005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 466/952] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:39 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:39.961082 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:39.961644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:39.967985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:39.968468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:39.968891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:39.969584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:39.970040 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:39.970494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:39.984262 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 HTTP/1.1 Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:39.985791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:39.987455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '8d1f19cb-20df-4e33-810d-5e2ced70ef28'} Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:39.988282 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:39.989595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:39.991403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:39.991403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-386d75eb-53ea-4d2f-9263-9adf580eec05 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 404 len: 111 microversion: 2.1 time: 0.029906 Oct 17 10:34:39.991403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 487/953] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:39 2022] DELETE /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:39.996528 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:39.997140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] [instance: 8d1f19cb-20df-4e33-810d-5e2ced70ef28] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:40.003535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:40.004020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:40.004455 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:40.005222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:40.005789 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:40.006251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:40.019357 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] HTTP exception thrown: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Request method failure captured: Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 HTTP/1.1 Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS12vPGELgAGrzJ9eS3j_U5gOw9RltmZfGxtxKSBXbhr8UcrpArsAd2Q9ZaIyXpxzMnUDuWsPYixg_KkjIlQdn3RjqbdqPL-Wn1q1wXEl31um4e0M4kl3ctgoZ_QgP28Dmp1jyfyFSsG7lU6zAvnwH5acCFINR-PC3s8_-Gc0gp85TQ Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:40.021160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ad3932c3fcc4d42b77b26f889ac694f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 9ad3932c3fcc4d42b77b26f889ac694f Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729444152 Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: eb7c6da9fd3c4b72a687daa923d07918 Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeTestJSON-729444152-project Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:40.022787 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '8d1f19cb-20df-4e33-810d-5e2ced70ef28'} Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:40.023617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. Oct 17 10:34:40.024841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:40.025943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] Returning 404 to user: Instance 8d1f19cb-20df-4e33-810d-5e2ced70ef28 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:40.025943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f5da67ca-bdd1-4542-9601-f99613791a23 tempest-AttachVolumeTestJSON-729444152 tempest-AttachVolumeTestJSON-729444152-project] 10.222.0.16 "GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28" status: 404 len: 111 microversion: 2.1 time: 0.029871 Oct 17 10:34:40.025943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 467/954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:39 2022] GET /compute/v2.1/servers/8d1f19cb-20df-4e33-810d-5e2ced70ef28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:40.596874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:40.597486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:40.604070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:40.604560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:40.605518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:40.606546 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:40.607144 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:40.607644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:40.826015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:40.835764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:40.837305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:40.838783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4c45bcb6-7968-48e4-8ca1-577889b27c26 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.245871 Oct 17 10:34:40.839582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 488/955] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:40 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:41.867581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:41.868385 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:41.884963 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:41.885460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:41.885908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:41.896169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:41.896731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:41.897898 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:42.130826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:42.147459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:42.149194 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:42.150812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0577690b-a1e8-4fd0-a644-c0c838425939 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.289315 Oct 17 10:34:42.154809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 468/956] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:41 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:43.185840 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:43.187322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:43.197127 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:43.197731 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:43.198426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:43.199149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:43.199607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:43.200035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:43.366504 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:43.384532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:43.393000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:43.395099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c39fdc7c-39d3-49c9-b52f-b6d06d70b610 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.213913 Oct 17 10:34:43.396267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 489/957] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:43 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:44.424821 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:44.426043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:44.434712 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:44.435506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:44.436239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:44.437145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:44.438039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:44.438716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:44.597900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:44.611504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:44.612984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:44.614184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3b99f15c-ee01-46b4-be13-4dcaf7b99bfd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.195744 Oct 17 10:34:44.615306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 469/958] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:44 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:45.111737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:45.113000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:45.120621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.121297 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.121890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.123255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.123897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.124481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.224024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'services' on Instance uuid 5861a58c-cacd-4d21-98ba-c8e7c3035149 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:45.329971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-10ec50b5-8c81-4983-9267-3d6975943d9a tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments/e67e2e06-016c-42a6-b9cb-46a20cee81a2" status: 202 len: 0 microversion: 2.1 time: 0.209158 Oct 17 10:34:45.331671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 490/959] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:34:45 2022] DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments/e67e2e06-016c-42a6-b9cb-46a20cee81a2 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:34:45.340342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:45.342749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:45.354198 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.355418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.356077 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.356982 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.357630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.358074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.416357 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7b31817e-5f76-4181-8bcc-05e97f15b3d8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080160 Oct 17 10:34:45.417287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 470/960] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:45 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:45.647812 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:45.649051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:45.657159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.657858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.658644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.659675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:45.665676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:45.667121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:45.844355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:45.848555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:45.857230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:45.858973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:45.860646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0d920000-3fdc-44cc-b7c3-af77654eb98e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.220796 Oct 17 10:34:45.861680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 491/961] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:45 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:46.441238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:46.444388 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:46.448119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:46.473426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.474634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.476772 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.477948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.478482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.478886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.529297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-648cde8b-3c72-4c7d-96de-84e4f4df86fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103157 Oct 17 10:34:46.536122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 471/962] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 17 10:34:46 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 10:34:46.611133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:46.611694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:46.625294 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.626115 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.626862 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.627940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.628709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.629494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.665119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:34:46.753833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-597b6952-7eae-48e4-9fb3-31e81bb4e0d6 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 204 len: 0 microversion: 2.1 time: 0.146191 Oct 17 10:34:46.754714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 492/963] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:46 2022] DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:34:46.767926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:46.768725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:46.775665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.776457 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.777150 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.778124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.778817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.779546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.893184 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:46.894199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:46.901389 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.903724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.904437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.905349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:46.906010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:46.906650 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:46.949423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:46.962242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-07ee1d60-96c5-46aa-8ed5-0d79772bd59f tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1681 microversion: 2.1 time: 0.201278 Oct 17 10:34:46.964110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 472/964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:46 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:47.105235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:47.114066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:47.116480 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:47.117655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-704478c8-acbe-422a-8677-b1d9149fb393 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.230220 Oct 17 10:34:47.118716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 493/965] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:46 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:34:47.992853 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:47.993425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:48.007512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:48.008011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:48.008452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:48.009167 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:48.009626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:48.010052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:48.152590 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:48.153422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:48.163691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:48.164463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:48.165108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:48.165961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:48.166772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:48.167978 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:48.285247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:48.294778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-734bfec3-0e4a-422a-a6c8-227063004fe3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1681 microversion: 2.1 time: 0.307187 Oct 17 10:34:48.296928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 473/966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:47 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1681 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:48.442027 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:48.451301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:48.453937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:48.455451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2fdb9f23-73f5-4cb7-8881-c87016419c40 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.312017 Oct 17 10:34:48.470658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 494/967] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:48 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:49.147549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:49.148899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:49.157277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.158301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.160022 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.161100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.161928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.162608 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.168535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:49.186108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.189536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.190475 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.214600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:34:49.217734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] Creating event network-changed:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:34:49.227030 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-369a6610-694d-4d3f-8f98-ae8fc26360c9 req-07ac94b0-2921-4d10-9407-55d8e39d2dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065138 Oct 17 10:34:49.227804 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 495/968] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:34:49.325512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:49.326550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:49.337230 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.341742 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.343816 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.344754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.348371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.350569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.356903 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cdaac5a9-769f-407e-9540-50a960912d4e tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 204 len: 0 microversion: 2.1 time: 0.213937 Oct 17 10:34:49.361683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 474/969] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:49 2022] DELETE /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:34:49.368031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:49.370561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:49.378314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.379105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.379794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.380747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.381427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.382800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.647942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:49.656428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-92e3ebf0-b1e6-469d-ae0d-48e42992188e tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1681 microversion: 2.1 time: 0.335354 Oct 17 10:34:49.661843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 496/970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:49 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:49.682835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:49.683824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:49.697303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.699143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.700797 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.701900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:49.705092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:49.705801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:49.737515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:49.748639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-06d1ddcd-3f4d-43c3-9b1b-09e4cb791562 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.384989 Oct 17 10:34:49.751552 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 475/971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:49 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:49.972798 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:49.987057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:49.990415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:49.991923 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-96fed5b9-cfc9-453a-a5c9-03cd0cb1feec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.328675 Oct 17 10:34:49.992729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 497/972] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:49 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:50.509629 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5861a58c-cacd-4d21-98ba-c8e7c3035149", "name": "network-vif-deleted", "tag": "b03fee14-0c20-4138-b286-c5ef934ceb22"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:50.530066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:50.531722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:50.532166 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:50.554818 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] Creating event network-vif-deleted:b03fee14-0c20-4138-b286-c5ef934ceb22 for instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 on hv-cinder-86020 Oct 17 10:34:50.564216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-fb0a7899-d234-4c2c-8ede-cd42d2c4ffe6 req-b495f3c9-a25e-4fad-9aa7-f7155c37c45e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066845 Oct 17 10:34:50.568533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 476/973] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:50.680008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:50.681630 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:50.688612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:50.689380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:50.689976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:50.691322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:50.691967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:50.692602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:50.776070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:50.779006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:50.793502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:50.794563 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:50.800171 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:50.804957 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:50.810316 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7d5a6cd2-d4fe-43f8-b4eb-0aeb0f3355c3 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1325 microversion: 2.1 time: 0.134311 Oct 17 10:34:50.811617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:50.813438 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:50.814777 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:50.815571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 498/974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:50 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1325 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:51.022125 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:51.022979 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:51.037286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:51.039726 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:51.040392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:51.043739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:51.045055 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:51.045505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:51.102477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:51.113035 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fa1e3a78-971e-4fb0-bf94-66c73c15b87f tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1569 microversion: 2.1 time: 0.342649 Oct 17 10:34:51.128274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 477/975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:50 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:51.274883 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:51.292193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:51.294349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:51.296809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3da66e2-0fbf-4956-a160-8b1d812f8f0a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.279313 Oct 17 10:34:51.319580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 499/976] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:51 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:51.855216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:51.856635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:51.865407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:51.866274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:51.867195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:51.868129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:51.869454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:51.870397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:51.915496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:51.916041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:51.916916 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:51.917601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lazy-loading 'fault' on Instance uuid 5861a58c-cacd-4d21-98ba-c8e7c3035149 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:51.923949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:52.111415 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b2700c20946ea93a1d20d7dea929f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a236cfbaf14211a6a3674f3c2f3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:52.125765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7ded4573-bdd6-4617-b93f-2448c0b98497 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 200 len: 1330 microversion: 2.1 time: 0.284014 Oct 17 10:34:52.127160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 478/977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:51 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 1330 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:52.139013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:52.140330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:52.151385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:52.158644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:52.159484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:52.160603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:52.161614 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:52.162284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:52.322620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:52.329440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:52.330267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:52.339796 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ffe88833-a73d-47e9-8dd5-214da4b90cd6 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1502 microversion: 2.1 time: 0.205285 Oct 17 10:34:52.340317 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:52.340878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:52.341374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:52.342651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:52.343670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:52.344163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:52.350503 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 500/978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:52 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:52.446296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4486fcaf-e909-4231-b425-7552ca3eeb54", "name": "network-vif-deleted", "tag": "083d8c37-1604-41ef-9b77-292a1de778b8"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:52.472190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:52.472835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:52.473290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:52.515805 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] Creating event network-vif-deleted:083d8c37-1604-41ef-9b77-292a1de778b8 for instance 4486fcaf-e909-4231-b425-7552ca3eeb54 on hv-cinder-86020 Oct 17 10:34:52.530265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-42c52ee5-fe01-4796-9e1d-4d80f5131507 req-2415b122-1251-4ef8-8728-45d56b918010 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089025 Oct 17 10:34:52.531148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 501/979] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:34:52.732900 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:52.743335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:52.746408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:52.747890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c52b151c-8b22-431c-bd2d-5078b11b98cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.426521 Oct 17 10:34:52.749044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 479/980] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:52 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:34:53.151069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:53.151764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:53.158921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.160541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.161521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.162631 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.163264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.164207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.184647 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 HTTP/1.1 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:53.193073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:53.194611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '5861a58c-cacd-4d21-98ba-c8e7c3035149'} Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:53.195482 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:53.196694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:53.200554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:53.201847 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5d51ce97-b978-4af3-922a-ba7a6634d52d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 404 len: 111 microversion: 2.1 time: 0.056025 Oct 17 10:34:53.203020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 502/981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:53 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:53.211949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ef4d65be-50af-47ec-9412-1116261bdbac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '.version_select at 0x7fe9ba79a820>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:53.236276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ef4d65be-50af-47ec-9412-1116261bdbac tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166359474" status: 202 len: 0 microversion: 2.1 time: 0.028987 Oct 17 10:34:53.236911 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 480/982] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 17 10:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166359474 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:34:53.372720 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:53.373649 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:53.391707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.393243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.394971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.396288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.398023 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.399004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.467682 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.468405 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.469590 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.470897 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lazy-loading 'fault' on Instance uuid 4486fcaf-e909-4231-b425-7552ca3eeb54 {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:34:53.552800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75018aeecd6843c0a75bc95e8757fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca835fdc95849cd8db1882ebb693cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:53.563186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2ec7cd5b-4342-408f-97b6-8d44e7309b99 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 200 len: 1225 microversion: 2.1 time: 0.202578 Oct 17 10:34:53.586353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 503/983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:53 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 1225 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:34:53.777440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:53.778468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:53.788463 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.789356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.790028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:53.790983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:53.791670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:53.792158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:54.021447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:54.030799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:54.033029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:54.034670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-14513608-098c-44db-aadc-658a6bf1b83a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1739 microversion: 2.20 time: 0.260810 Oct 17 10:34:54.035440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 481/984] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:53 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:54.609338 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:54.609974 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] [instance: 4486fcaf-e909-4231-b425-7552ca3eeb54] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:54.616319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:54.616966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:54.617291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:54.617962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:54.618443 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:54.618952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:54.632417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] HTTP exception thrown: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Request method failure captured: Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 HTTP/1.1 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS41eQyb7RwtSzWOUh0SEFTsgfsEI8yBql8ptnVppZoR5T3-yKWgntjdqJkOpjvoAlAYXhOKi_tKgnDYmWDHnUQwNGcALX4fF-lRtFfjrzNEiOlgExl1Q_rY6Krezk1kAYVybe_F71jORfyy0yFWgDFy_fBcoqQGDSQL_Wzf7H5rZfs Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 8ca835fdc95849cd8db1882ebb693cc3 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-TestShelveInstance-364783174 Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:54.634079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ca835fdc95849cd8db1882ebb693cc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8ca835fdc95849cd8db1882ebb693cc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8ca835fdc95849cd8db1882ebb693cc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8ca835fdc95849cd8db1882ebb693cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-TestShelveInstance-364783174 Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 8ca835fdc95849cd8db1882ebb693cc3 Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-TestShelveInstance-364783174 Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-TestShelveInstance-364783174-project Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 75018aeecd6843c0a75bc95e8757fd8a Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-TestShelveInstance-364783174-project Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. Oct 17 10:34:54.635628 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '4486fcaf-e909-4231-b425-7552ca3eeb54'} Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:54.636432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. Oct 17 10:34:54.637700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:54.638890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Returning 404 to user: Instance 4486fcaf-e909-4231-b425-7552ca3eeb54 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:54.638890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7baf46eb-680b-4e0a-b3c9-e47ef4065565 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54" status: 404 len: 111 microversion: 2.1 time: 0.030235 Oct 17 10:34:54.638890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 504/985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:54 2022] GET /compute/v2.1/servers/4486fcaf-e909-4231-b425-7552ca3eeb54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:54.816994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9072610c-d9db-4937-80e6-150422f37181 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] Calling method '.version_select at 0x7fe9ba5d7310>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:54.841861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9072610c-d9db-4937-80e6-150422f37181 tempest-TestShelveInstance-364783174 tempest-TestShelveInstance-364783174-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1451062318" status: 202 len: 0 microversion: 2.1 time: 0.028418 Oct 17 10:34:54.846032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 482/986] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 17 10:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1451062318 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 10:34:55.066517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:55.066517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:55.072535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.073108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.074155 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.075656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.077314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.077864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.299582 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:55.308014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:55.309652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:55.311007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8b76fd81-5563-4706-9c29-7e2f2a84c0cd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1721 microversion: 2.20 time: 0.250760 Oct 17 10:34:55.311661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 505/987] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:55 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:55.356653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:55.357173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:55.365122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.365625 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.366071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.367368 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.367836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.368271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.383524 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 HTTP/1.1 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:55.385264 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.386910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '5861a58c-cacd-4d21-98ba-c8e7c3035149'} Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:55.387832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.389289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.390699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:55.390699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a40f0254-f5be-4e48-9442-620d81a494a5 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 404 len: 111 microversion: 2.1 time: 0.036104 Oct 17 10:34:55.395884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:55.396635 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 5861a58c-cacd-4d21-98ba-c8e7c3035149] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:55.399461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 483/988] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:55 2022] DELETE /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:34:55.402515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.403004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.403437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.404139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:55.404595 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:55.405020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:55.419248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 HTTP/1.1 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:55.420982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.422676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '5861a58c-cacd-4d21-98ba-c8e7c3035149'} Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:55.423591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. Oct 17 10:34:55.425100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:55.427142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 5861a58c-cacd-4d21-98ba-c8e7c3035149 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:55.427142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-76b7569a-77dc-4c72-bb66-eddcc2a67592 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149" status: 404 len: 111 microversion: 2.1 time: 0.030858 Oct 17 10:34:55.427142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 506/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:55 2022] GET /compute/v2.1/servers/5861a58c-cacd-4d21-98ba-c8e7c3035149 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:56.339086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:56.339719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:56.354849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.355857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.356548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.357495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.358196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.358890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.600915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:56.601616 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:56.610032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.610304 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:56.610879 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.611324 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.612239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.613105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.613706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.621770 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:56.623269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:56.624480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bcbed8c9-927c-445c-8e4e-9e5f301d3e2f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1721 microversion: 2.20 time: 0.289357 Oct 17 10:34:56.625360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 484/990] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:56 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:56.632195 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d HTTP/1.1 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:56.634121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.635637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'b72c375f-ee9a-4b63-acc8-a2ac6bc2240d'} Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:56.636392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.637677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.639001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:56.639001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7d07c968-43a9-498c-b9fa-aae62b19f539 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 404 len: 111 microversion: 2.1 time: 0.041237 Oct 17 10:34:56.639001 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 507/991] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:56 2022] DELETE /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:34:56.645612 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:56.646439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: b72c375f-ee9a-4b63-acc8-a2ac6bc2240d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:56.652662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.653159 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.653597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.654392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.654853 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.655283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.672924 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d HTTP/1.1 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:56.675868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.679131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'b72c375f-ee9a-4b63-acc8-a2ac6bc2240d'} Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:56.680006 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. Oct 17 10:34:56.681239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.683561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance b72c375f-ee9a-4b63-acc8-a2ac6bc2240d could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:56.683561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a2aa421f-fdb9-4c4d-88ab-39bc55d06ee8 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d" status: 404 len: 111 microversion: 2.1 time: 0.036489 Oct 17 10:34:56.683561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 485/992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:56 2022] GET /compute/v2.1/servers/b72c375f-ee9a-4b63-acc8-a2ac6bc2240d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:56.687800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:56.688287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:56.695604 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.696098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.696536 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.697243 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.697701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.698130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.712645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 HTTP/1.1 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:56.714655 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.716160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '51aad574-c9a9-4a6e-8210-38ae14243987'} Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:56.717090 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.718667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.720399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:56.720399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6cebeec0-6cdf-49cf-9caa-b58fadb9bc70 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 404 len: 111 microversion: 2.1 time: 0.032330 Oct 17 10:34:56.720399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 508/993] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:56 2022] DELETE /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:34:56.725259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:56.725878 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: 51aad574-c9a9-4a6e-8210-38ae14243987] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:56.733955 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.734575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.735090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.736004 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:56.736566 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:56.737071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:56.752102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 HTTP/1.1 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:56.753892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.755938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '51aad574-c9a9-4a6e-8210-38ae14243987'} Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:56.756710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. Oct 17 10:34:56.759064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:56.761674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance 51aad574-c9a9-4a6e-8210-38ae14243987 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:56.761674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f5d08a51-e7de-4c2b-b947-67daa2f2a6fc tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987" status: 404 len: 111 microversion: 2.1 time: 0.034723 Oct 17 10:34:56.761674 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 486/994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:56 2022] GET /compute/v2.1/servers/51aad574-c9a9-4a6e-8210-38ae14243987 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:34:57.650609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:57.651219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:57.658235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:57.658757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:57.659463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:57.659881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:57.660798 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:57.662034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:57.865214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:57.878830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:57.881558 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:57.883814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-061bd9d0-705f-4f52-a3c3-5a02b3b55efd tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1721 microversion: 2.20 time: 0.237055 Oct 17 10:34:57.884983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 509/995] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:57 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:57.940272 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:57.940804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:57.950637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:57.951326 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:57.953655 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:57.954781 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:57.955475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:57.959802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:57.997779 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 HTTP/1.1 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:34:57.999411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.000763 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'e0dd552f-1059-4d09-a797-ac62de74b383'} Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:58.001512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.003908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.005232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:58.005232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9d928183-0a00-4acd-9ee9-165ff7f9b08d tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 404 len: 111 microversion: 2.1 time: 0.064569 Oct 17 10:34:58.005232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 487/996] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:34:57 2022] DELETE /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:58.009791 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:58.010445 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] [instance: e0dd552f-1059-4d09-a797-ac62de74b383] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:58.019450 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:58.019948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:58.020795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:58.021993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:58.022584 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:58.025634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:58.057132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] HTTP exception thrown: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Request method failure captured: Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 HTTP/1.1 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS1zfTjekyNY-uqdniu533FuPRWRPbUpLVjoFUFIJFm57ZkKq9ANOgILFDfgCg-sxXyZn-n-MY0k4RJ890dXzhSf_ub8_frVZiLAc9Hwj3ecDdmKYrKyyyR_c4pRyQYjNFOrKXUdGyIwmf_jFpisxvGL-Yd_asr-25rNwzU0YDw-vKM Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:34:58.059690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/41a236cfbaf14211a6a3674f3c2f3a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 41a236cfbaf14211a6a3674f3c2f3a67 Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-967130162 Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 6b4b2700c20946ea93a1d20d7dea929f Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeNegativeTest-967130162-project Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.061164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'e0dd552f-1059-4d09-a797-ac62de74b383'} Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:34:58.062086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. Oct 17 10:34:58.063407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:34:58.064520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] Returning 404 to user: Instance e0dd552f-1059-4d09-a797-ac62de74b383 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:34:58.064520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8439214c-9f3c-4ff9-b5e9-8677ccf9af58 tempest-AttachVolumeNegativeTest-967130162 tempest-AttachVolumeNegativeTest-967130162-project] 10.222.0.16 "GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383" status: 404 len: 111 microversion: 2.1 time: 0.058243 Oct 17 10:34:58.064520 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 510/997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:34:58 2022] GET /compute/v2.1/servers/e0dd552f-1059-4d09-a797-ac62de74b383 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:34:58.205670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "name": "network-vif-unplugged", "status": "completed", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:58.237451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:58.240268 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:58.240778 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:58.256786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] Creating event network-vif-unplugged:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:34:58.275628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-8f32dcf8-3b6c-46ea-8526-c740cf0f0a25 req-eed6d2d2-2bab-4b7f-b82c-9d77861d654e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073407 Oct 17 10:34:58.278128 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 488/998] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:34:58.913416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:34:58.914770 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:58.921463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:58.921949 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:58.922404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:58.923101 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:58.923724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:58.924350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:59.137927 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:59.141660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:34:59.147985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:59.149349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:34:59.150548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-62bfd224-389a-49ca-ab68-217cecf9cad6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1664 microversion: 2.20 time: 0.242823 Oct 17 10:34:59.158782 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 511/999] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:34:58 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:34:59.177871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0c54ab3-72eb-4e77-88ea-afdc9cce2a18"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:59.181533 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:59.199741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:59.200246 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:59.200689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:59.201411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:59.201867 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:59.203633 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:59.688169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-31811ad7-ee56-4a57-b978-a8409a4ec21b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.514683 Oct 17 10:34:59.696172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 489/1000] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 17 10:34:59 2022] POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 10:34:59.841335 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:34:59.842251 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:34:59.848970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:59.849939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:59.850811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:59.851713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:34:59.852591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:34:59.853453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:34:59.932364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118679) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 10:35:00.046381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b752f21c-53ff-467e-8c0c-dc9c125d5bcc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/action" status: 202 len: 0 microversion: 2.20 time: 0.212728 Oct 17 10:35:00.050468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 512/1001] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 10:34:59 2022] POST /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:35:00.056720 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:00.057726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:00.076850 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:00.077774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:00.078402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:00.086107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:00.086931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:00.089029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:00.402001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:00.422051 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:00.423893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:00.428571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0f9dd49c-882c-4fe4-992f-6caf89ca3711 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1750 microversion: 2.20 time: 0.375711 Oct 17 10:35:00.429084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 490/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:00 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1750 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:01.457229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:01.457980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:01.468057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:01.473076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:01.474442 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:01.475416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:01.476236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:01.476913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:01.885241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:01.903975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:01.905717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:01.907131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ead2d332-4ba3-433b-9591-e040632f2c8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1750 microversion: 2.20 time: 0.455868 Oct 17 10:35:01.908565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 513/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:01 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1750 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:02.938930 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:02.940239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:02.960760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:02.963858 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:02.964522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:02.965705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:02.966393 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:02.967005 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:03.264642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:03.274364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:03.278504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:03.279729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d746a8fd-e87c-439c-9b0c-77482c0e882f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1752 microversion: 2.20 time: 0.346827 Oct 17 10:35:03.280303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 491/1004] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:02 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1752 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:04.309274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:04.309982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:04.325193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:04.327242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:04.327952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:04.328827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:04.329414 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:04.330295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:04.510783 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:04.521784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:04.526157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:04.528333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4956d9b8-8915-4f59-8d96-2387ef4fe226 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.224694 Oct 17 10:35:04.529330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 514/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:04 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:05.555049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:05.555894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:05.566537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:05.567345 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:05.568003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:05.568969 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:05.569804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:05.570479 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:05.749427 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:05.763536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:05.765168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:05.766448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-fa7e5192-a80d-4dcc-b5ed-2aca4d86b012 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.216014 Oct 17 10:35:05.767451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 492/1006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:05 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:06.797305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:06.803288 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:06.817792 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:06.821999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:06.822795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:06.823784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:06.824476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:06.825117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:07.073803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:07.089065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:07.093000 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:07.096095 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d2b5a6f1-b272-42fa-b56a-33bfe0798cba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.306751 Oct 17 10:35:07.108769 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 515/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:06 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:08.127599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:08.128931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:08.137296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:08.138034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:08.138661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:08.139534 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:08.140365 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:08.140798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:08.319715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:08.337086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:08.339210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:08.340422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5d392668-2028-4d17-bda5-8a81ece32316 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.217515 Oct 17 10:35:08.345367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 493/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:08 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:09.372239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:09.373463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:09.378972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:09.395129 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:09.395785 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:09.396303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:09.397014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:09.397713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:09.398137 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:09.606150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:09.617124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:09.618910 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:09.620531 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cf9f475f-9592-43b3-a204-8146ef1ee07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.254615 Oct 17 10:35:09.621302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 516/1009] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:09 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:10.651807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:10.652560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:10.664182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:10.666483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:10.667202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:10.668286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:10.668827 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:10.669584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:10.893169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 10:35:10.893425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Mon Oct 17 10:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 (ip 10.222.0.16) !!! Oct 17 10:35:10.949490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:10.970532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:10.971991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:10.973731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2cefc6ab-6b7c-4100-a488-ac481a40086e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.328239 Oct 17 10:35:10.992954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 494/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:10 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:12.008983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:12.010250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:12.021278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:12.021982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:12.022629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:12.023919 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:12.024534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:12.025116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:12.266059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:12.275904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:12.277801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:12.279187 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-acf185cc-166a-428c-97ca-8992ca67a5d1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.276917 Oct 17 10:35:12.280286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 517/1011] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:12 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:13.307212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:13.308961 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:13.318283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:13.318812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:13.319248 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:13.320484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:13.321468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:13.322426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:13.528238 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:13.548480 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:13.550224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:13.552381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-827be37f-2811-4d13-8fd9-11067d2438c5 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.248489 Oct 17 10:35:13.553253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 495/1012] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:13 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:14.581281 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:14.591360 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:14.603447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:14.605916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:14.607093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:14.608197 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:14.608997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:14.609696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:14.815085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:14.830640 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:14.833551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:14.836179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4ba252c7-8e74-45a9-a142-67505f7ca9d3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.258559 Oct 17 10:35:14.838180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 518/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:14 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:15.863842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:15.865643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:15.872081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:15.872561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:15.873192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:15.873921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:15.874576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:15.875010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:16.011883 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:16.022800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:16.024645 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:16.025902 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0d2204ed-87d4-4e1f-9c23-5f1e441f2cc8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.166139 Oct 17 10:35:16.034459 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 496/1014] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:15 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:35:17.050873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:17.051962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:17.058268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:17.058780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:17.059217 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:17.059906 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:17.060385 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:17.060813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:17.187959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:17.197072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:17.198562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:17.199724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-be7e92df-75dd-47bc-8238-b2a1cd1618b9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.152867 Oct 17 10:35:17.200286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 519/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:17 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:35:18.226014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:18.226613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:18.229138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:18.235424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:18.235943 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:18.236387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:18.237092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:18.237552 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:18.237983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:18.370397 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:18.373829 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:18.379879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:18.381327 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:18.382521 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c1bd7f01-ddbb-4a2a-a5cf-b8f8a6ee672e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.161508 Oct 17 10:35:18.383094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 497/1016] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:18 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:19.408834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:19.409447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:19.417411 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:19.417963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:19.418366 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:19.419085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:19.419543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:19.419999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:19.570978 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:19.580523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:19.581983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:19.583446 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e18b62d9-0e09-4954-b364-8d8244d43b8f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.178643 Oct 17 10:35:19.583818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 520/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:19 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:20.612599 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:20.613313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:20.619530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:20.620200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:20.620646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:20.621356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:20.621820 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:20.622242 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:20.771517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:20.780872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:20.782311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:20.783633 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0224725c-9354-4902-8eb7-d085d2619c8a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.176515 Oct 17 10:35:20.784186 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 498/1018] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:20 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:21.809478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:21.810970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:21.818434 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:21.819136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:21.819766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:21.820517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:21.820978 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:21.821404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:21.989716 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:22.000624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:22.002085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:22.003292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9ad25e1d-bb12-4307-9176-a924ebbfb590 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.198127 Oct 17 10:35:22.004052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 521/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:21 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:23.030877 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:23.031395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:23.038070 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:23.038591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:23.039031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:23.039893 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:23.040367 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:23.040785 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:23.210797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:23.221294 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:23.225662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:23.225662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-089e0280-5a21-49e5-9c65-60ed1f188655 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.198381 Oct 17 10:35:23.225662 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 499/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:23 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:35:24.251942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:24.252710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:24.260304 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:24.261140 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:24.261725 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:24.262592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:24.263057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:24.263558 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:24.412960 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:24.422543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:24.423672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:24.425180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-75b3a88c-b56f-4342-a3b4-2eb03fa6e0a9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.177085 Oct 17 10:35:24.426462 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 522/1021] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:24 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:25.451055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:25.451646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:25.459307 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:25.459804 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:25.460243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:25.461133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:25.461601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:25.462017 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:25.596200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:25.606081 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:25.607575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:25.608771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d14da070-3087-44da-9f68-0f5456c90daf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.161857 Oct 17 10:35:25.609366 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 500/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:25 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:26.635020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:26.635753 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:26.642246 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:26.642764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:26.643204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:26.643900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:26.644357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:26.645383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:26.775607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:26.784259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:26.785958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:26.787172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fa44397f-eeaa-47ec-a359-f5bdc88ed999 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.156128 Oct 17 10:35:26.787734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 523/1023] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:26 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:27.812692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:27.813374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:27.820145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:27.820624 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:27.821056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:27.821744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:27.822195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:27.822650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:27.957642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:27.966106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:27.967598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:27.968791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-179b6586-fca6-4c59-be42-eb04275ef83c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.160002 Oct 17 10:35:27.969353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 501/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:27 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:28.994747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:28.995298 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:29.001732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:29.002250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:29.002758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:29.003473 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:29.004569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:29.005083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:29.139734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:29.148260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:29.149700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:29.150892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-01d909b2-1f72-4784-8f05-4d6069b0f909 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.160232 Oct 17 10:35:29.151443 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 524/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:28 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:30.177041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:30.177638 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:30.184278 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:30.184756 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:30.185187 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:30.185879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:30.186356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:30.186788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:30.325807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:30.336107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:30.337564 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:30.338846 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f561610a-e5a1-46ac-88f3-27cf65153259 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.166260 Oct 17 10:35:30.339418 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 502/1026] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:30 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:31.365589 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:31.366204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:31.372660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:31.373150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:31.373583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:31.374286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:31.374829 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:31.375254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:31.381818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:31.515031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:31.524089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:31.525519 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:31.526713 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-422925bc-0dda-4680-b939-bcc05e0fd2b3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.165522 Oct 17 10:35:31.527481 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 525/1027] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:31 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:35:32.552635 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:32.553244 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:32.559561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:32.560071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:32.560502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:32.561188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:32.561637 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:32.562056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:32.699851 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:32.708447 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:32.709879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:32.711057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-259f0589-fcb4-4dc0-a7a6-380cba454dfc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.162847 Oct 17 10:35:32.711611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 503/1028] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:32 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:33.735587 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:33.736167 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:33.743062 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:33.743541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:33.744005 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:33.744711 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:33.745159 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:33.745579 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:33.900732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:33.910672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:33.912264 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:33.913444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b45ead4c-0b70-4641-ab8c-a4d6236a58ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.182055 Oct 17 10:35:33.914003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 526/1029] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:33 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:34.938311 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:34.938965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:34.945617 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:34.946100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:34.946580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:34.947273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:34.947738 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:34.948163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:35.080123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:35.091276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:35.092718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:35.093892 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4a0f9aa5-4c02-4091-9ae7-4b2efc21f12e tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.159604 Oct 17 10:35:35.094594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 504/1030] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:34 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:36.035208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "name": "network-vif-plugged", "status": "completed", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:35:36.045977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:36.046496 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:36.047065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:36.059421 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] Creating event network-vif-plugged:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:35:36.064560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-205d7781-bdb9-42fd-9be4-bc9ea8f99bde req-bc8a302a-21a1-4e46-9167-678f97a07d3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Oct 17 10:35:36.065208 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 527/1031] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:35:36.120309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:36.120922 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:36.127731 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:36.128153 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:36.129117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:36.129814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:36.130274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:36.130722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:36.262782 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:36.272090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:36.273708 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:36.275294 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e7577d57-4162-44d7-988e-677a8d20802b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.158958 Oct 17 10:35:36.276182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 505/1032] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:36 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:37.302918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:37.303620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:37.309715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:37.310196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:37.310659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:37.311379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:37.311832 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:37.312255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:37.449107 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:37.458069 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:37.459551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:37.460696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-16352257-0843-427f-a5a9-a834d5d44baa tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.163475 Oct 17 10:35:37.461252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 528/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:37 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:38.487208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:38.487836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:38.495263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:38.496237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:38.496237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:38.496936 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:38.497493 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:38.497971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:38.646056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:38.656698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:38.658245 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:38.659603 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ba2e0a3c-813d-4a5b-9070-380ac520a4f8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.176769 Oct 17 10:35:38.660538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 506/1034] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:38 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:39.685874 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:39.686511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:39.689142 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=26 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:39.700025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:39.700548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:39.701181 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:39.701908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:39.712242 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:39.712773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:39.856963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:39.867274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:39.869085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:39.870376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d842e175-3af4-4f33-b6c4-7da1645dd7f6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1808 microversion: 2.20 time: 0.189083 Oct 17 10:35:39.870975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 529/1035] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:39 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:35:40.896478 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:40.897100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:40.906395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:40.906395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:40.906395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:40.906395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:40.906861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:40.908776 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:41.052665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:41.062155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:41.063845 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:41.065061 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-541b6f20-674e-433a-9f4b-dac1e3cef06f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1795 microversion: 2.20 time: 0.172899 Oct 17 10:35:41.065632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 507/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:35:40 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1795 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:35:48.584546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10f389b-b9a0-4b8c-8d62-d4d3032b267d", "tag": "4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:35:48.588982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:48.589478 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:48.595664 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=22 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:48.602657 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:48.603158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:48.603529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:48.603746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:48.604377 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:48.604509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:48.604915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:48.605570 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:48.605701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:48.617998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] Creating event network-changed:4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b for instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d on hv-cinder-86020 Oct 17 10:35:48.632470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-8482d034-7cb8-46e3-bf60-521419411044 req-919b824e-ac0a-42e5-a2f6-7dec3593da4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043197 Oct 17 10:35:48.632894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:35:48.633442 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 508/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:35:48.718612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d206a43a-a5ea-4504-9dd0-edbfc6a04830 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 204 len: 0 microversion: 2.1 time: 0.141118 Oct 17 10:35:48.719210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 530/1038] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:35:48 2022] DELETE /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:35:48.727916 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:48.728753 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:48.735321 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:48.735880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:48.736323 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:48.737018 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:48.737476 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:48.737908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:48.873496 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:48.882207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-da08c2a4-665e-4934-a54b-075cff5fe374 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1577 microversion: 2.1 time: 0.158598 Oct 17 10:35:48.882816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 509/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:48 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:35:49.906833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:49.907455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:49.914577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:49.915065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:49.915502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:49.916196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:49.916660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:49.917089 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:50.047426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:50.055427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0eb93469-d3ba-49ef-9ff9-d6aceab9e8bb tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1577 microversion: 2.1 time: 0.152911 Oct 17 10:35:50.055995 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 531/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:49 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:51.078574 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:51.079192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:51.086788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:51.087288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:51.087734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:51.088449 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:51.088915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:51.089346 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:51.092199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=69 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:35:51.296273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:51.304583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-27e616b3-b77f-43df-9781-a3193e872145 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1577 microversion: 2.1 time: 0.229893 Oct 17 10:35:51.305161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 510/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:51 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1577 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:52.328375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:52.328985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:52.336200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:52.336621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:52.337054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:52.337751 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:52.338203 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:52.338653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:52.469174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:52.477091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-47608eee-b067-4258-89b0-3701a6bc4b2e tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1458 microversion: 2.1 time: 0.152548 Oct 17 10:35:52.477675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 532/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:52 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:52.748408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10f389b-b9a0-4b8c-8d62-d4d3032b267d", "name": "network-vif-deleted", "tag": "4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:35:52.758740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:52.759214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:52.759643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:52.770613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] Creating event network-vif-deleted:4260e77a-fc2d-4ccb-9cf7-e5d9bc08db6b for instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d on hv-cinder-86020 Oct 17 10:35:52.776620 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-b8234c2b-b2c4-4911-99c3-c3d2b305a665 req-314bf3e1-b645-4aa2-aab1-86cd3c9d0de8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150296 Oct 17 10:35:52.777232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 511/1043] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:35:53.499997 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:53.500665 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:53.507372 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:53.507853 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:53.508287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:53.508972 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:53.509427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:53.509848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:53.574706 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:53.582484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-67f8cf15-50c0-447e-89ca-eac47d35ef04 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1224 microversion: 2.1 time: 0.086325 Oct 17 10:35:53.583058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 533/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:53 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:54.606273 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:54.607058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:54.613156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:54.613641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:54.614080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:54.615398 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:54.616037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:54.616451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:54.682705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:54.690536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0bb00b4d-74a4-47a9-a22d-13a38e59899f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1224 microversion: 2.1 time: 0.089203 Oct 17 10:35:54.691099 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 512/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:54 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:55.713025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:55.713642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:55.719976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:55.720453 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:55.720877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:55.721765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:55.722049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:55.722451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:55.786147 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:55.794284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a24ccdca-7f50-4211-829f-5f3c9045bf86 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1224 microversion: 2.1 time: 0.085074 Oct 17 10:35:55.794866 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 534/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:55 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:56.818983 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:56.819605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:56.826041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:56.826560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:56.827002 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:56.827688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:56.828145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:56.828571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:56.890234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:56.898009 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-47f5f160-5351-414d-ad06-9665f136fe6c tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1224 microversion: 2.1 time: 0.083898 Oct 17 10:35:56.898605 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 513/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:56 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:57.920865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:57.921499 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:57.927903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:57.928386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:57.928818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:57.929509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:57.929963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:57.930409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:57.992702 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:58.000416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-853f0239-a37b-4359-8cb3-e0bdcc0de967 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1224 microversion: 2.1 time: 0.083332 Oct 17 10:35:58.000983 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 535/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:57 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:35:59.024975 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:35:59.025685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:35:59.032489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:59.032987 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:59.033428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:59.034134 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:59.034647 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:59.035105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:59.067025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:35:59.067555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:35:59.068122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:35:59.068539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lazy-loading 'fault' on Instance uuid b10f389b-b9a0-4b8c-8d62-d4d3032b267d {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:35:59.115755 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:35:59.123632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cfbe8daa-a263-435a-bec1-72bf49d16482 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 200 len: 1229 microversion: 2.1 time: 0.103819 Oct 17 10:35:59.124200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 514/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:35:59 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:00.147486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:00.148094 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: b10f389b-b9a0-4b8c-8d62-d4d3032b267d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:00.154358 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:00.154849 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:00.155284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:00.155975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:00.156433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:00.156857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:00.170292 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] HTTP exception thrown: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Request method failure captured: Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d HTTP/1.1 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS29WE27LbpbscF_NjyBFuLq3r1eIbsgIr5rsv9nIfACdyRnHQNoo7JneuQtJsteugli0ii9-LU4SZpsi4mRQsLbMk_N-VwEyZlMyyCMk2RgdUmMrwQihDi3yZZcXDKMH1IKxN788N-nHNKLf5EX-ih8JN_JrnM55vgg9cSoK44TSU8 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:36:00.171973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e87741d68c74ae29ecea930893e3449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: a5b7190649694b9882ab34c0f3114a3e Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. Oct 17 10:36:00.173694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'b10f389b-b9a0-4b8c-8d62-d4d3032b267d'} Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:00.174694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. Oct 17 10:36:00.176285 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:00.177800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Returning 404 to user: Instance b10f389b-b9a0-4b8c-8d62-d4d3032b267d could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:00.177800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-eea6e126-8e1d-47fb-b35e-d5aa296b8907 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d" status: 404 len: 111 microversion: 2.1 time: 0.030411 Oct 17 10:36:00.177800 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 536/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:00 2022] GET /compute/v2.1/servers/b10f389b-b9a0-4b8c-8d62-d4d3032b267d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:36:03.537933 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:03.538489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:03.540239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7", "tag": "ce13d5d3-e1be-4216-ad2c-ea8b09580322"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:03.545330 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:03.545822 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:03.546261 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:03.547218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:03.547842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:03.548478 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:03.551461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:03.552019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:03.552516 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:03.556728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:03.565340 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] Creating event network-changed:ce13d5d3-e1be-4216-ad2c-ea8b09580322 for instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 on hv-cinder-86020 Oct 17 10:36:03.572722 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-12efc123-2a07-4c56-a548-9abab564072d req-1691335b-6836-4ced-92d8-46551165bcf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 Oct 17 10:36:03.573383 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 537/1051] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:36:03.592758 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:36:03.672076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-45dc38e2-7765-49bb-8c89-048062d5d269 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 204 len: 0 microversion: 2.1 time: 0.138452 Oct 17 10:36:03.672661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 515/1052] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:36:03 2022] DELETE /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:36:03.682302 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:03.683029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:03.689952 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:03.690465 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:03.690902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:03.691597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:03.692052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:03.692661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:03.823825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:03.831607 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7285aeef-1187-478f-ac39-35673a2107c3 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1578 microversion: 2.1 time: 0.154370 Oct 17 10:36:03.832177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 538/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:03 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:04.856208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:04.856819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:04.864279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:04.864769 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:04.865212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:04.866748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:04.867203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:04.867632 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:05.003319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:05.012596 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9b75ea80-6e1e-4b7e-9a9c-3389126c9ddf tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1578 microversion: 2.1 time: 0.161018 Oct 17 10:36:05.013200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 516/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:04 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:06.035399 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:06.036031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:06.043219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:06.043710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:06.044151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:06.044852 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:06.045311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:06.045739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:06.183374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:06.191214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9eec3090-28e8-425c-a7d6-2894d4123d4f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1578 microversion: 2.1 time: 0.159724 Oct 17 10:36:06.191892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 539/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:06 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:36:07.215235 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:07.215847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:07.222100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:07.222610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:07.223057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:07.223745 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:07.224208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:07.224874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:07.363568 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:07.372772 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-40a02f64-a349-4e93-97e3-6d0cd197a630 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1578 microversion: 2.1 time: 0.161513 Oct 17 10:36:07.373354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 517/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:07 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:08.314590 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7", "name": "network-vif-deleted", "tag": "ce13d5d3-e1be-4216-ad2c-ea8b09580322"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:08.325704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:08.326316 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:08.326632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:08.338215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] Creating event network-vif-deleted:ce13d5d3-e1be-4216-ad2c-ea8b09580322 for instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 on hv-cinder-86020 Oct 17 10:36:08.343321 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-aceaa43b-43d0-49cb-ad45-855dca0a3df7 req-d7f7bad3-63b1-48b1-a5ed-0e11c74f5366 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Oct 17 10:36:08.344022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 540/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:08.397371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:08.398791 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:08.406579 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:08.407325 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:08.407839 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:08.408790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:08.409469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:08.409998 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:08.482408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b7190649694b9882ab34c0f3114a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e87741d68c74ae29ecea930893e3449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:08.490938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-dfed7436-4724-4323-af36-252c64f3e238 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 200 len: 1224 microversion: 2.1 time: 0.097778 Oct 17 10:36:08.491523 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 518/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:08 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:09.515371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:09.516074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:09.522513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:09.523010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:09.523442 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:09.525784 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:09.526250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:09.526715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:09.540571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] HTTP exception thrown: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Request method failure captured: Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 HTTP/1.1 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS29WE27LbpbscF_NjyBFuLq3r1eIbsgIr5rsv9nIfACdyRnHQNoo7JneuQtJsteugli0ii9-LU4SZpsi4mRQsLbMk_N-VwEyZlMyyCMk2RgdUmMrwQihDi3yZZcXDKMH1IKxN788N-nHNKLf5EX-ih8JN_JrnM55vgg9cSoK44TSU8 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:36:09.542356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e87741d68c74ae29ecea930893e3449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: a5b7190649694b9882ab34c0f3114a3e Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. Oct 17 10:36:09.544078 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7'} Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:09.545028 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. Oct 17 10:36:09.547286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:09.548789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Returning 404 to user: Instance 5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:09.548789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-48b03790-ff38-4ee1-8164-c34f26e37597 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7" status: 404 len: 111 microversion: 2.1 time: 0.033493 Oct 17 10:36:09.548789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 541/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:09 2022] GET /compute/v2.1/servers/5feb12d9-1ccb-42e8-a3b6-0cdc8f2cdcf7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:36:10.037979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:10.038507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:10.045588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:10.046229 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:10.046700 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:10.048100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:10.048726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:10.049484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:10.066222 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] HTTP exception thrown: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Request method failure captured: Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 HTTP/1.1 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS29WE27LbpbscF_NjyBFuLq3r1eIbsgIr5rsv9nIfACdyRnHQNoo7JneuQtJsteugli0ii9-LU4SZpsi4mRQsLbMk_N-VwEyZlMyyCMk2RgdUmMrwQihDi3yZZcXDKMH1IKxN788N-nHNKLf5EX-ih8JN_JrnM55vgg9cSoK44TSU8 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:36:10.068192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e87741d68c74ae29ecea930893e3449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: a5b7190649694b9882ab34c0f3114a3e Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.069604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '12170369-6077-4716-adf0-a110aebc1525'} Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:10.070510 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.072705 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.074020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Returning 404 to user: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:10.074020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2818b521-f81f-4bc7-8f6b-af964244f12f tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "DELETE /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 404 len: 111 microversion: 2.1 time: 0.035697 Oct 17 10:36:10.074020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 519/1060] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:36:10 2022] DELETE /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 10:36:10.079183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:10.079825 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] [instance: 12170369-6077-4716-adf0-a110aebc1525] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:10.081881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:10.088182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:10.088704 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:10.089166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:10.089901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:10.090487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:10.090916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:10.118483 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] HTTP exception thrown: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Request method failure captured: Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 HTTP/1.1 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS29WE27LbpbscF_NjyBFuLq3r1eIbsgIr5rsv9nIfACdyRnHQNoo7JneuQtJsteugli0ii9-LU4SZpsi4mRQsLbMk_N-VwEyZlMyyCMk2RgdUmMrwQihDi3yZZcXDKMH1IKxN788N-nHNKLf5EX-ih8JN_JrnM55vgg9cSoK44TSU8 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:36:10.122218 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e87741d68c74ae29ecea930893e3449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e87741d68c74ae29ecea930893e3449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 0e87741d68c74ae29ecea930893e3449 Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-TestVolumeBootPattern-244674561 Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: a5b7190649694b9882ab34c0f3114a3e Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-TestVolumeBootPattern-244674561-project Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.123653 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '12170369-6077-4716-adf0-a110aebc1525'} Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:10.124479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. Oct 17 10:36:10.125936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:36:10.127241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Returning 404 to user: Instance 12170369-6077-4716-adf0-a110aebc1525 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:10.127241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-15fefa36-c75c-4f95-8879-f3bf3f1fab2b tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525" status: 404 len: 111 microversion: 2.1 time: 0.048544 Oct 17 10:36:10.130386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 542/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:10 2022] GET /compute/v2.1/servers/12170369-6077-4716-adf0-a110aebc1525 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:36:11.599868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-07f4234e-21f4-4369-927f-82cb4e91d6c6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] Calling method '.version_select at 0x7fe9ba55e790>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:11.621788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-07f4234e-21f4-4369-927f-82cb4e91d6c6 tempest-TestVolumeBootPattern-244674561 tempest-TestVolumeBootPattern-244674561-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785350402" status: 202 len: 0 microversion: 2.1 time: 0.025731 Oct 17 10:36:11.622688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 520/1062] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 17 10:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785350402 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:36:12.584351 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-258765484", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "networks": [{"uuid": "e2337280-a404-47c6-b03c-fc7e9a1f3a14"}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:12.642581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] validate_networks() for [('e2337280-a404-47c6-b03c-fc7e9a1f3a14', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:36:13.361868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:36:13.362290 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:36:13.363130 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:36:13.363659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:36:13.364158 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:36:13.376935 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:13.377530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:13.383732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:13.384545 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:13.385108 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:13.385624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:13.403124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Getting quotas for project 711ab39e17604b0d9df8ef228108396c. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:36:13.407354 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Getting quotas for user 90e4dd806c804309aece8b368e0fb67e and project 711ab39e17604b0d9df8ef228108396c. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:36:13.419843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:36:13.422485 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:36:13.470119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-41a7cd2b-fd25-48f2-848e-a2786b29bb65 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889474 Oct 17 10:36:13.470786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 543/1063] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:36:13.482869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-030b9243-50ff-43f2-9579-88fca83520db tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:13.484073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-030b9243-50ff-43f2-9579-88fca83520db tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:13.544067 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-030b9243-50ff-43f2-9579-88fca83520db tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:13.551209 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-030b9243-50ff-43f2-9579-88fca83520db tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1213 microversion: 2.1 time: 0.072423 Oct 17 10:36:13.552205 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 521/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:13 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:14.575487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-13491e8e-8d1b-49e7-bba4-217d67eb731b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:14.576093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-13491e8e-8d1b-49e7-bba4-217d67eb731b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:14.655668 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-13491e8e-8d1b-49e7-bba4-217d67eb731b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:14.668133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-13491e8e-8d1b-49e7-bba4-217d67eb731b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1213 microversion: 2.1 time: 0.097251 Oct 17 10:36:14.669300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 544/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:14 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:15.694973 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4fe4736d-fba4-4309-8d86-3ca4810b048a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:15.696431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4fe4736d-fba4-4309-8d86-3ca4810b048a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:15.771710 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4fe4736d-fba4-4309-8d86-3ca4810b048a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:15.780243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4fe4736d-fba4-4309-8d86-3ca4810b048a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1213 microversion: 2.1 time: 0.092556 Oct 17 10:36:15.781109 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 522/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:15 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:16.802757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bf9dc0fe-3d76-403c-bd37-196493c862e5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:16.803678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bf9dc0fe-3d76-403c-bd37-196493c862e5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:16.861712 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bf9dc0fe-3d76-403c-bd37-196493c862e5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:16.871119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bf9dc0fe-3d76-403c-bd37-196493c862e5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1213 microversion: 2.1 time: 0.072256 Oct 17 10:36:16.871701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 545/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:16 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:17.895861 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:17.896630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:17.905774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:17.906744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:17.907466 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:17.908426 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:17.909040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:17.909978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:17.979354 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:17.987702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7a5f3482-938f-4f0e-911c-3bdfe175c7d1 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1217 microversion: 2.1 time: 0.095870 Oct 17 10:36:17.988283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 523/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:17 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:19.014052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:19.015675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:19.024645 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:19.025715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:19.025715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:19.026575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:19.027485 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:19.027986 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:19.094947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:19.103304 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-623624e0-f6cc-4341-8fda-eea36b13c60a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1271 microversion: 2.1 time: 0.096948 Oct 17 10:36:19.103903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 546/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:19 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:36:20.128054 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:20.129739 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:20.139413 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:20.142843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:20.144110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:20.144630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:20.146145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:20.147003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:20.148581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:20.419765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:20.427520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c720be7c-5691-41bf-9370-36fbbbecfec5 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.303642 Oct 17 10:36:20.428021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 524/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:20 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:20.582087 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02bad36c-2d41-4253-9bb7-a47b2b8ca78c", "tag": "1b63ebfe-be2a-4132-add4-acd688d0583a"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:20.592461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:20.592948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:20.593426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:20.607269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] Creating event network-changed:1b63ebfe-be2a-4132-add4-acd688d0583a for instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c on hv-cinder-86020 Oct 17 10:36:20.612658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-e49c56a1-8321-44c0-8115-6cf7be324057 req-b0b576f7-99a8-42c2-852c-4392c80dc8bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Oct 17 10:36:20.613565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 547/1071] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:21.450709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:21.451319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:21.457816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:21.458298 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:21.458762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:21.459456 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:21.459916 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:21.460341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:21.464932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:21.598245 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:21.606719 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d4fc38ad-1f1b-4794-99bb-f562c920d2d9 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.159950 Oct 17 10:36:21.607279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 525/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:21 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:22.630182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:22.630903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:22.637598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:22.638080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:22.638548 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:22.639233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:22.639681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:22.640103 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:22.767612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:22.775760 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e20cc3d0-ff61-46a4-824f-d06f6aa9b74d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.149761 Oct 17 10:36:22.776260 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 548/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:22 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:23.799049 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:23.799656 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:23.806871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:23.807372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:23.807788 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:23.808474 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:23.808930 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:23.809361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:23.941709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:23.949430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a21799bb-cd21-43e1-8ce4-8dbf73e438c6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.154404 Oct 17 10:36:23.950019 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 526/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:23 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:24.971962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:24.972688 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:24.974633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:24.981426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:24.981902 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:24.982356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:24.983063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:24.983512 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:24.983928 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:25.113154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:25.121370 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3b383c60-9de3-4519-ba97-88eeeddb7e86 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.153328 Oct 17 10:36:25.122116 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 549/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:24 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:26.143826 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:26.144356 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:26.146634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:26.152175 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:26.152650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:26.153084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:26.153767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:26.154220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:26.154670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:26.281688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:26.289232 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-366c6c5d-f207-42ca-9e4e-ec0797baec42 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.149288 Oct 17 10:36:26.290424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 527/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:26 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:27.311987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:27.312596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:27.315017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=10 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:27.322035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:27.322553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:27.322988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:27.323684 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:27.324133 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:27.324571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:27.468349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:27.476009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-890ba415-379a-4d48-a1aa-555e8eaaf310 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.167851 Oct 17 10:36:27.476574 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 550/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:27 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:27.538197 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bad36c-2d41-4253-9bb7-a47b2b8ca78c", "name": "network-vif-plugged", "status": "completed", "tag": "1b63ebfe-be2a-4132-add4-acd688d0583a"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:27.548495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:27.548972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:27.549401 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:27.560163 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] Creating event network-vif-plugged:1b63ebfe-be2a-4132-add4-acd688d0583a for instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c on hv-cinder-86020 Oct 17 10:36:27.565108 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-edb14c68-a5e4-46ee-8a12-29af0b90798f req-6ee31400-dc86-4b63-a2c0-d91aefe4fbeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222843 Oct 17 10:36:27.565685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 528/1078] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:28.499968 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:28.500575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:28.507009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:28.507489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:28.507918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:28.509019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:28.509468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:28.509889 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:28.637513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:28.645045 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-706396a6-a31c-4b76-b4fb-93fbcd057d2b tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1313 microversion: 2.1 time: 0.149096 Oct 17 10:36:28.645611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 551/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:28 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:29.668773 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:29.669469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:29.675627 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:29.676103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:29.676535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:29.677218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:29.677671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:29.678092 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:29.806873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:29.814592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-8d8ed5ed-df65-4c8e-92a0-08ae47eed456 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1496 microversion: 2.1 time: 0.151662 Oct 17 10:36:29.815162 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 529/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:29 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:30.309051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:30.309618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:30.315750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:30.316240 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:30.316678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:30.317374 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:30.317833 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:30.318259 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:30.346535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:36:30.422011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0c7666c9-5ad6-49fd-8129-7328a305d68e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "DELETE /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 204 len: 0 microversion: 2.1 time: 0.117121 Oct 17 10:36:30.422654 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 552/1081] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:36:30 2022] DELETE /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:36:30.431333 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:30.431950 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:30.437975 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:30.438502 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:30.438946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:30.439643 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:30.440105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:30.440536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:30.569594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:30.578145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9ede39c1-5c94-406b-9cfe-d956dd41589a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1502 microversion: 2.1 time: 0.151268 Oct 17 10:36:30.578779 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 530/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:30 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:31.601561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:31.602588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:31.609336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:31.609819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:31.610252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:31.610976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:31.611431 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:31.611856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:31.745148 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:31.752846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-49274ce5-586d-4f11-afa7-8dd0326480f2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1502 microversion: 2.1 time: 0.155516 Oct 17 10:36:31.753418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 553/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:31 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:32.516389 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bad36c-2d41-4253-9bb7-a47b2b8ca78c", "name": "network-vif-deleted", "tag": "1b63ebfe-be2a-4132-add4-acd688d0583a"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:32.527385 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:32.527860 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:32.528279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:32.540802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] Creating event network-vif-deleted:1b63ebfe-be2a-4132-add4-acd688d0583a for instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c on hv-cinder-86020 Oct 17 10:36:32.545854 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-5a9528e0-08ae-4c21-ab1f-a7155dbb8863 req-9d528465-6e44-414a-addb-001a82fc7f2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 17 10:36:32.546477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 531/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:32.776915 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:32.777567 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:32.783943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:32.784430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:32.784865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:32.785563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:32.786022 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:32.786490 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:32.817371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:32.817848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:32.818286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:32.818754 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lazy-loading 'fault' on Instance uuid 02bad36c-2d41-4253-9bb7-a47b2b8ca78c {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:36:32.859409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:32.867375 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fb266aeb-427d-45a2-8518-59e48ab445ce tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 200 len: 1303 microversion: 2.1 time: 0.095142 Oct 17 10:36:32.868036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 554/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:32 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:33.891613 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:33.892344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: 02bad36c-2d41-4253-9bb7-a47b2b8ca78c] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:33.898600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:33.899549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:33.899988 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:33.900693 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:33.901155 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:33.901583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:33.915923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] HTTP exception thrown: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Request method failure captured: Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c HTTP/1.1 Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTTAadu_2kCApXnnYNBnxg0fh1i23IhG9Sh1h5JX_wTE4yvXg6WXGNwdCoep9yvM4h7NzZmXO8TVc5z7NEUGxVZo1_S40a2FPmydJi47suxblacBRl7H4-2q4ZyYsDCh7siQt6NYr_8yueMp6qDXGAjrRbVED5fkbLMKROj9otFDKfdE Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 711ab39e17604b0d9df8ef228108396c Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesActionsTest-282512453 Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:36:33.917583 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_711ab39e17604b0d9df8ef228108396c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesActionsTest-282512453 Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 711ab39e17604b0d9df8ef228108396c Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesActionsTest-282512453 Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesActionsTest-282512453-project Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 90e4dd806c804309aece8b368e0fb67e Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesActionsTest-282512453-project Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. Oct 17 10:36:33.919335 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '02bad36c-2d41-4253-9bb7-a47b2b8ca78c'} Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:33.921116 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. Oct 17 10:36:33.922722 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:33.924180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Returning 404 to user: Instance 02bad36c-2d41-4253-9bb7-a47b2b8ca78c could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:33.924180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-572ca69d-aeb8-44f1-a4cc-40d5445bc1a6 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c" status: 404 len: 111 microversion: 2.1 time: 0.032309 Oct 17 10:36:33.924180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 532/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:33 2022] GET /compute/v2.1/servers/02bad36c-2d41-4253-9bb7-a47b2b8ca78c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:36:34.029074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1212018698", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "networks": [{"uuid": "e2337280-a404-47c6-b03c-fc7e9a1f3a14"}]}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:34.082881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.network.neutron [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] validate_networks() for [('e2337280-a404-47c6-b03c-fc7e9a1f3a14', None, None, None, None, None)] {{(pid=118679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:36:34.432231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Flavor limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:36:34.432658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Image limits 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:36:34.433131 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Flavor pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:36:34.433541 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Image pref 0:0:0 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:36:34.433958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.virt.hardware [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:36:34.442991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:34.443407 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:34.443841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:34.444568 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:34.445020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:34.446036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:34.453401 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:34.466772 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Getting quotas for project 711ab39e17604b0d9df8ef228108396c. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:36:34.470973 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.quota [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Getting quotas for user 90e4dd806c804309aece8b368e0fb67e and project 711ab39e17604b0d9df8ef228108396c. Resources: {'instances', 'cores', 'ram'} {{(pid=118679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:36:34.482940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Going to run 1 instances... {{(pid=118679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:36:34.485198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:36:34.530415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-190f7de3-e06a-4c70-b3ee-930ff7a7e039 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505369 Oct 17 10:36:34.531067 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 555/1087] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:36:34.542445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22375e84-7ace-4092-be3d-374591950d36 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:34.543064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-22375e84-7ace-4092-be3d-374591950d36 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:34.596921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-22375e84-7ace-4092-be3d-374591950d36 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:34.604411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-22375e84-7ace-4092-be3d-374591950d36 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1214 microversion: 2.1 time: 0.066382 Oct 17 10:36:34.604985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 533/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:34 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:35.629618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:35.630265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:35.638182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:35.638863 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:35.639234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:35.640113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:35.640560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:35.640991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:35.705666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:35.713856 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-888d4956-bfcf-4496-ad21-f33e843d2d9a tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1274 microversion: 2.1 time: 0.089174 Oct 17 10:36:35.714467 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 556/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:35 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:36.737191 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:36.738769 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:36.746240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:36.746749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:36.747182 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:36.747872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:36.748359 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:36.748783 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:36.930577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:36.938313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-37fcca83-ffa3-461e-8a69-96d9bda8aacd tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.205088 Oct 17 10:36:36.938908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 534/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:36 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:37.023814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e087175e-cf41-48bc-ac0a-cce50eeaa84e", "tag": "57a279a3-cef0-491e-9501-c8ec74b6e737"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:37.034526 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:37.035004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:37.035435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:37.046588 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] Creating event network-changed:57a279a3-cef0-491e-9501-c8ec74b6e737 for instance e087175e-cf41-48bc-ac0a-cce50eeaa84e on hv-cinder-86020 Oct 17 10:36:37.051562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-c820f419-d384-4e7b-8009-5f13acb00959 req-e5816ffc-b5e0-492d-b566-f9fbc496ca81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032500 Oct 17 10:36:37.052157 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 557/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:37.963119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:37.963701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:37.970279 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:37.970948 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:37.971385 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:37.972106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:37.972598 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:37.973026 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.108576 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:38.116320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-86956e4a-e006-41c5-b5c7-ca62fe5ea942 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.158276 Oct 17 10:36:38.116894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 535/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:37 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:38.572269 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:38.572851 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:38.579331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.579814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.580252 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.580947 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.581402 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.581826 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.610046 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2f1ae021-5cac-48f4-8b80-5b89eb0d1edc tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments/e0c54ab3-72eb-4e77-88ea-afdc9cce2a18" status: 200 len: 194 microversion: 2.20 time: 0.043402 Oct 17 10:36:38.610666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 558/1093] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Oct 17 10:36:38 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments/e0c54ab3-72eb-4e77-88ea-afdc9cce2a18 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:36:38.677348 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:38.677933 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:38.684843 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.685332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.685801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.686546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.687010 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.687439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.767456 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lazy-loading 'services' on Instance uuid 239b5400-d752-426a-a5f1-fe0746c3e990 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:36:38.840375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6061c0df-c30d-48e8-80e5-e36d95331043 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments/e0c54ab3-72eb-4e77-88ea-afdc9cce2a18" status: 202 len: 0 microversion: 2.20 time: 0.166800 Oct 17 10:36:38.840971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 536/1094] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 17 10:36:38 2022] DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments/e0c54ab3-72eb-4e77-88ea-afdc9cce2a18 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:36:38.849245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:38.851518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:38.857875 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.858393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.858865 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.859555 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:38.860014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:38.860433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:38.890368 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c40aed07-600c-4cc8-b99a-02f404d41c86 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045018 Oct 17 10:36:38.890921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 559/1095] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 10:36:38 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:36:39.140859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:39.141558 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:39.147767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:39.148243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:39.148673 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:39.150352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:39.150837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:39.151260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:39.277448 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:39.285072 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-68eef4f4-d277-47c3-a878-4eabc69f9581 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.149047 Oct 17 10:36:39.285631 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 537/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:39 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:39.903562 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:39.905629 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:39.912232 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:39.912717 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:39.913234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:39.913936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:39.914415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:39.915329 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:39.947551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b190c8f3-6a2d-4851-8ff2-16553e09ffa4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048208 Oct 17 10:36:39.948306 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 560/1097] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 10:36:39 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:36:40.308145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:40.308990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:40.315614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:40.316103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:40.316538 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:40.317265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:40.317728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:40.318152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:40.457165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:40.465773 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ef470bf9-6008-43d7-9faf-d4475258d3ca tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.161891 Oct 17 10:36:40.466360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 538/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:40 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:40.960156 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:40.962389 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:40.964808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:40.971041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:40.971524 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:40.971962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:40.972658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:40.973113 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:40.973538 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.004035 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-83b7f45e-278a-4552-b2b7-237d3c0b66ea tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047957 Oct 17 10:36:41.004585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 561/1099] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 10:36:40 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:41.065869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:41.066390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:41.072937 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.073425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.073859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.074773 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.075056 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.075470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.100303 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:36:41.179485 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e6c495dd-9d06-4784-9f2a-38b843b0a10a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 204 len: 0 microversion: 2.20 time: 0.117030 Oct 17 10:36:41.181702 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 539/1100] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 10:36:41 2022] DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 10:36:41.189818 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:41.190486 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:41.196422 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.196990 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.197427 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.198122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.198597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.199021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.333671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:41.342380 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:41.343841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:41.345015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4eb7b8d0-838d-4339-a951-44d45dd9d6f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.159091 Oct 17 10:36:41.345578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 562/1101] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:41 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:41.491260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:41.491885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:41.498616 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.499110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.499549 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.500252 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:41.500711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:41.501139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:41.633594 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:41.641430 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2d574ef0-071d-4c43-a456-c567b9f9b1e8 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.154562 Oct 17 10:36:41.641997 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 540/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:41 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:42.373058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:42.373667 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:42.380059 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:42.380552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:42.380970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:42.381652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:42.382099 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:42.382550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:42.510106 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:42.518104 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:42.519571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:42.520727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7bc9ceb5-ad86-484c-8126-9c04fd1866ab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1723 microversion: 2.20 time: 0.152783 Oct 17 10:36:42.521286 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 563/1103] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:42 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:42.664361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:42.665565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:42.672021 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:42.672499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:42.672928 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:42.673614 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:42.674064 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:42.674519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:42.803453 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:42.811552 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b58ed5c5-ef67-4065-b1b6-502bdd79ca4d tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.151060 Oct 17 10:36:42.812113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 541/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:42 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:43.441697 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e087175e-cf41-48bc-ac0a-cce50eeaa84e", "name": "network-vif-plugged", "status": "completed", "tag": "57a279a3-cef0-491e-9501-c8ec74b6e737"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:43.453506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.453993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.454517 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.468393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] Creating event network-vif-plugged:57a279a3-cef0-491e-9501-c8ec74b6e737 for instance e087175e-cf41-48bc-ac0a-cce50eeaa84e on hv-cinder-86020 Oct 17 10:36:43.473532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-3dfa1361-6cf6-4494-a208-6fc09dc9bf7f req-90b3c82d-932c-47be-925b-711a83c048e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035736 Oct 17 10:36:43.474138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 564/1105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:43.545654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:43.546257 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:43.552536 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.553052 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.553611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.554318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.554816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.555266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.575396 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:43.631269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:43.640602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:43.642076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:43.643268 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-09324e61-90db-417b-90c6-f303eb2284f9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1656 microversion: 2.20 time: 0.101673 Oct 17 10:36:43.644028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 542/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:43 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1656 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:43.835074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:43.835767 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:43.843009 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.843500 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.843931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.845179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.845179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.845487 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.904014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b5400-d752-426a-a5f1-fe0746c3e990", "name": "network-vif-deleted", "tag": "cca519f2-c8ec-4e21-9d79-8c8665f98315"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:43.914381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:43.915247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:43.915691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:43.927439 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] Creating event network-vif-deleted:cca519f2-c8ec-4e21-9d79-8c8665f98315 for instance 239b5400-d752-426a-a5f1-fe0746c3e990 on hv-cinder-86020 Oct 17 10:36:43.933445 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-05f57566-885e-4940-9b74-6738ffaf2031 req-3e13d3ca-9b2c-461b-9f1b-1e7c6ea7ea8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033354 Oct 17 10:36:43.934055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 543/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:36:43.999330 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:44.007651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a03fd1bf-3509-47b3-b42c-d65fb9aa7d7c tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.176906 Oct 17 10:36:44.008276 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 565/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:43 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:44.672395 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:44.673299 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:44.675338 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:44.682037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:44.682554 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:44.682989 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:44.683762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:44.684220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:44.684641 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:44.717694 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:44.718461 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:44.718895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:44.719340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lazy-loading 'fault' on Instance uuid 239b5400-d752-426a-a5f1-fe0746c3e990 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:36:44.763752 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:44.771767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:44.773221 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:44.775011 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c9252cfd-6233-4515-bf6b-2b92679183f0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 200 len: 1372 microversion: 2.20 time: 0.108909 Oct 17 10:36:44.775564 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 544/1109] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:44 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:45.032532 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:45.033179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:45.035600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:45.036309 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=6 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:45.042560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:45.043043 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:45.043474 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:45.044165 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:45.044617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:45.045036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:45.186505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:45.194120 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-045d119d-c526-4912-a972-9c6d2c051d02 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1314 microversion: 2.1 time: 0.165902 Oct 17 10:36:45.194710 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 566/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:45 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:45.800691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:45.801306 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:45.808658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:45.809144 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:45.809581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:45.810281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:45.810768 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:45.811200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:45.824963 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 HTTP/1.1 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:36:45.826760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:36:45.828318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '239b5400-d752-426a-a5f1-fe0746c3e990'} Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:45.829274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:36:45.830869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:45.832253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:45.832253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9c021dc2-eb0b-4e31-ad07-0c334f1888ae tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 404 len: 111 microversion: 2.20 time: 0.031625 Oct 17 10:36:45.832253 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 545/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:45 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:36:45.839762 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f021f364-cde1-4788-ae65-3a53a95fb62b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '.version_select at 0x7fe9bdf8c0d0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:45.844258 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f021f364-cde1-4788-ae65-3a53a95fb62b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [eff9e69d-7b8a-4ec8-9ad7-17c9b4b84e3b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 10:36:46.218494 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:46.219104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:46.225038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:46.225519 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:46.225956 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:46.226670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:46.227750 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:46.228270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:46.359652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:46.367457 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c99809d1-c1b0-416f-bee5-2e2599820673 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1497 microversion: 2.1 time: 0.152876 Oct 17 10:36:46.368090 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 546/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:46 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:36:46.864003 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO oslo.messaging._drivers.impl_rabbit [None req-f021f364-cde1-4788-ae65-3a53a95fb62b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [eff9e69d-7b8a-4ec8-9ad7-17c9b4b84e3b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60512. Oct 17 10:36:46.866934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:46.867437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:46.874766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:46.875188 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:46.875628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:46.876332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:46.876794 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:46.877287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:46.884942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f021f364-cde1-4788-ae65-3a53a95fb62b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914329244" status: 204 len: 0 microversion: 2.20 time: 1.049315 Oct 17 10:36:46.885620 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 567/1113] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 17 10:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914329244 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 10:36:46.904653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:36:46.982112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9f05ed75-d524-4cc4-95ad-6d213c217d3e tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 204 len: 0 microversion: 2.1 time: 0.119197 Oct 17 10:36:46.982813 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 547/1114] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:36:46 2022] DELETE /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 10:36:46.993161 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:46.993891 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:47.000526 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:47.001007 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:47.001435 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:47.002177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:47.002677 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:47.003098 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:47.162118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:47.170969 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-96fb61ec-d2cb-4b3e-ae21-c11b0bd78668 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1503 microversion: 2.1 time: 0.182365 Oct 17 10:36:47.171632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 568/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:46 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:47.525863 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6a831839-4aa7-401a-ae62-bc6446f9c7ca tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: .version_select at 0x7fe9ba95be50>, body: {"keypair": {"name": "tempest-keypair-1867892735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkuDRHdG72MnOo5se+si6iGI3U1usMiOrEN703Rfqv+kZZ/jvLbRgrXL6vUnmQ67IpUFSAMDxcqaqTIzLkFJ6tyzNkX4WvGKonkiUXU2LWqGx/CSqWk91rUJJtU23LteQ=="}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:47.541689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-6a831839-4aa7-401a-ae62-bc6446f9c7ca tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:36:47.545686 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-6a831839-4aa7-401a-ae62-bc6446f9c7ca tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for user e5efdc755c6a43f9b8cf570ac38b25eb and project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'key_pairs'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:36:47.567689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6a831839-4aa7-401a-ae62-bc6446f9c7ca tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046673 Oct 17 10:36:47.568276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 548/1116] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 17 10:36:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 10:36:48.195031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:48.195700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:48.201977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:48.202511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:48.202953 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:48.203656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:48.204112 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:48.204537 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:48.393740 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:48.402248 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8629cc61-ae2b-40d4-9069-e9b2e8a87816 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1503 microversion: 2.1 time: 0.211198 Oct 17 10:36:48.402862 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 569/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:48 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:36:48.917465 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-580298854", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fd95ede-ecf3-40ce-8613-a421ab553445"}], "security_groups": [{"name": "tempest-securitygroup--1694652352"}], "key_name": "tempest-keypair-1867892735", "user_data": "}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:49.064065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] validate_networks() for [('4fd95ede-ecf3-40ce-8613-a421ab553445', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:36:49.193294 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e087175e-cf41-48bc-ac0a-cce50eeaa84e", "name": "network-vif-deleted", "tag": "57a279a3-cef0-491e-9501-c8ec74b6e737"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:49.203177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.203896 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.204079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.216200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] Creating event network-vif-deleted:57a279a3-cef0-491e-9501-c8ec74b6e737 for instance e087175e-cf41-48bc-ac0a-cce50eeaa84e on hv-cinder-86020 Oct 17 10:36:49.222050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-39e5d294-3b1a-4170-a5e0-04b98255abe7 req-752e6031-e70c-4f5f-a750-7ceadd1164f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Oct 17 10:36:49.223054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 570/1118] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:36:49.427237 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:49.427937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:49.434625 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.435105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.435734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.436433 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.436877 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.437470 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.470132 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.470646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.471074 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.471506 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lazy-loading 'fault' on Instance uuid e087175e-cf41-48bc-ac0a-cce50eeaa84e {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:36:49.513367 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e4dd806c804309aece8b368e0fb67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '711ab39e17604b0d9df8ef228108396c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:49.520971 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0521784d-da4e-4130-9aa0-cd1cfd732235 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 200 len: 1304 microversion: 2.1 time: 0.098437 Oct 17 10:36:49.521543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 571/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:49 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:36:49.522819 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:36:49.523270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:36:49.523740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:36:49.525411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:36:49.525828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:36:49.535214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.535802 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.536237 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.536958 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:49.537409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:49.537830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:49.554471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:36:49.558832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Getting quotas for user e5efdc755c6a43f9b8cf570ac38b25eb and project 6a41305c4efa44edb98d1ca076ccbdff. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:36:49.569881 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:36:49.572718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:36:49.623991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-bae07e13-b84c-499d-90cf-d295bf36a20f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.711336 Oct 17 10:36:49.624634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 549/1120] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 17 10:36:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 10:36:49.636387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:49.637400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:49.698542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:49.706621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:49.708291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:49.709415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-99feda50-8515-4a47-9745-1ebe30e11b37 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1281 microversion: 2.20 time: 0.077551 Oct 17 10:36:49.725450 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 572/1121] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:49 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:50.544573 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:50.545181 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] [instance: e087175e-cf41-48bc-ac0a-cce50eeaa84e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:50.547228 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:50.553642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:50.554125 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:50.554586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:50.555687 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:50.555828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:50.556168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:50.571421 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] HTTP exception thrown: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Request method failure captured: Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e HTTP/1.1 Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTTAadu_2kCApXnnYNBnxg0fh1i23IhG9Sh1h5JX_wTE4yvXg6WXGNwdCoep9yvM4h7NzZmXO8TVc5z7NEUGxVZo1_S40a2FPmydJi47suxblacBRl7H4-2q4ZyYsDCh7siQt6NYr_8yueMp6qDXGAjrRbVED5fkbLMKROj9otFDKfdE Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 711ab39e17604b0d9df8ef228108396c Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesActionsTest-282512453 Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:36:50.573062 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_711ab39e17604b0d9df8ef228108396c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/711ab39e17604b0d9df8ef228108396c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesActionsTest-282512453 Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 711ab39e17604b0d9df8ef228108396c Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesActionsTest-282512453 Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesActionsTest-282512453-project Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 90e4dd806c804309aece8b368e0fb67e Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesActionsTest-282512453-project Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. Oct 17 10:36:50.574800 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'e087175e-cf41-48bc-ac0a-cce50eeaa84e'} Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:36:50.575944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. Oct 17 10:36:50.577543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:36:50.579032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] Returning 404 to user: Instance e087175e-cf41-48bc-ac0a-cce50eeaa84e could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:36:50.579032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5d55f0de-5a7e-4583-bdc9-ca7216868bc2 tempest-VolumesActionsTest-282512453 tempest-VolumesActionsTest-282512453-project] 10.222.0.16 "GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e" status: 404 len: 111 microversion: 2.1 time: 0.033929 Oct 17 10:36:50.579032 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 550/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:36:50 2022] GET /compute/v2.1/servers/e087175e-cf41-48bc-ac0a-cce50eeaa84e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:36:50.735593 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:50.736353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:50.743666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:50.744448 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:50.745085 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:50.746038 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:50.746741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:50.747362 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:50.822549 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:50.832644 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:50.834122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:50.835315 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c42e6f99-96e3-475f-9db5-987294d3c536 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1351 microversion: 2.20 time: 0.104489 Oct 17 10:36:50.836216 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 573/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:50 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:51.863374 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:51.863950 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:51.871634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:51.872112 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:51.872539 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:51.873239 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:51.873692 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:51.874169 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:52.086094 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:52.094946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:52.096400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:52.097517 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5dfbfe95-7f09-44d6-bfb4-e74d00933822 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.238174 Oct 17 10:36:52.098082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 551/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:51 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:52.264827 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:36:52.275523 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:52.276004 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:52.276430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:52.287226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] Creating event network-changed:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:36:52.292715 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-c513b88c-8577-44fc-b615-f2d21796d4c4 req-4180b937-ec75-4e73-bd93-11e5d58b3d44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031583 Oct 17 10:36:52.293345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 574/1125] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:36:53.123817 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:53.124458 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:53.130925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:53.131407 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:53.131846 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:53.132535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:53.132990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:53.133486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:53.261034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:53.269082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:53.270555 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:53.271670 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1356c540-40df-432c-9085-fb21a60f988a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.151828 Oct 17 10:36:53.272203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 552/1126] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:53 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:54.297970 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:54.298719 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:54.305675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:54.306459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:54.306908 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:54.307670 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:54.308177 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:54.308681 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:54.440065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:54.448852 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:54.450300 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:54.451430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-66de0fe4-4fe0-4685-bd15-9728ead99e9b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.158403 Oct 17 10:36:54.452052 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 575/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:54 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:55.476041 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:55.476654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:55.483634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:55.484106 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:55.484543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:55.485240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:55.485697 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:55.486123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:55.953040 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:55.961814 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:55.963601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:55.964717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d1f1dbf4-6d61-4fd3-a591-903faadb9739 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.492630 Oct 17 10:36:55.965280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 553/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:55 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:36:56.994958 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:56.996010 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:57.004994 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:57.005976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:57.007117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:57.008371 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:57.008988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:57.009577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:57.172956 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:57.175600 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=100 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:36:57.183367 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:57.184962 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:57.186279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ba4ae4bf-c1ca-4d0a-99ff-2140f0d98a35 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.198980 Oct 17 10:36:57.187061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 576/1129] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:56 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:58.215661 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:58.217340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:58.226650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:58.228267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:58.229267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:58.230363 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:58.231535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:58.232345 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:58.389507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:58.397907 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:58.399437 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:58.400920 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f6aad99a-6469-4d34-810c-c9329c765060 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.190050 Oct 17 10:36:58.401647 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 554/1130] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:58 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:36:59.434123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:36:59.435633 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:36:59.443505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:59.444418 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:59.446106 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:59.447598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:36:59.448117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:36:59.448765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:36:59.638172 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:59.646831 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:59.648271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:36:59.650336 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-826eba08-73eb-41d6-a748-c88d0881b24a tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.221195 Oct 17 10:36:59.656515 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 577/1131] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:36:59 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:37:00.677274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:37:00.678058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:37:00.681260 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:37:00.682736 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=10 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:37:00.689002 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:00.689492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:00.690129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:00.690901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:00.691357 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:00.691780 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:00.840318 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:00.855297 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:00.857639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:00.859391 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a3e40e80-4e87-4e3b-b517-03d42c0c00d6 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.186076 Oct 17 10:37:00.882894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 555/1132] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:37:00 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:37:01.908209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:37:01.908728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:37:01.911180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:37:01.924961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:01.926182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:01.931409 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:01.936510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:01.937305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:01.937618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:02.037173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "name": "network-vif-plugged", "status": "completed", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:37:02.049434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:02.050499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:02.051174 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:02.067076 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] Creating event network-vif-plugged:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:37:02.074886 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-d030b568-c0fd-4238-a341-0fff7ba5227b req-d78b9fda-a970-467e-8953-c0a4c20d2bf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041153 Oct 17 10:37:02.076197 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 556/1133] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:37:02.122100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:02.131730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:02.133440 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:02.135057 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bd12b7a7-02f7-4281-a632-40260ebf544b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.234546 Oct 17 10:37:02.136224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 578/1134] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:37:01 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:37:03.162218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:37:03.162956 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:37:03.171436 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:03.171924 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:03.172571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:03.173440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:03.173925 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:03.174372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:03.315277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:03.324757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:03.326520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:03.327740 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-488ab9ad-195e-4f0f-a599-4238dfaf046c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1407 microversion: 2.20 time: 0.170480 Oct 17 10:37:03.328375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 557/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:37:03 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:37:04.354531 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:37:04.356087 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:37:04.362764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:04.363331 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:04.363781 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:04.364488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:04.364944 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:04.365569 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:04.529869 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:04.538277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:04.539846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:37:04.541312 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3d5835d-93a2-4fb5-8d6f-96ab1985700f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1598 microversion: 2.20 time: 0.191767 Oct 17 10:37:04.542042 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 579/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:37:04 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1598 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:37:04.567308 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:37:04.568522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:37:04.576288 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:04.576808 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:04.577328 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:04.578186 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:04.578680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:04.579173 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:04.670435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a122f8ff-fc9f-45c9-809b-77542b1de5fb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107103 Oct 17 10:37:04.672811 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 558/1137] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 17 10:37:04 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:37:05.709408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:37:05.721729 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:37:05.722573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:37:05.723199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:37:05.736334 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] Creating event network-changed:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:37:05.741737 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-2faeb319-bc47-463b-bd0e-73366c57a48b req-8388ff64-440c-4688-ab63-a8f4fd4f2369 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Oct 17 10:37:05.746806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 580/1138] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:38:10.618984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=17 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:10.619741 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:10.842484 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:10.843057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:10.849292 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:10.849830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:10.850271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:10.850994 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:10.851450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:10.851874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:10.876501 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d74e7c51-c56d-4d03-9298-44e94ef4e37d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/ips" status: 200 len: 150 microversion: 2.20 time: 0.259525 Oct 17 10:38:10.876993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 559/1139] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 17 10:38:10 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/ips => generated 150 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 10:38:12.697053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:12.697789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=21 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:12.703696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:38:12.704393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:12.711743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:12.712364 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:12.712864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:12.713577 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:12.714025 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:12.714476 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:12.738376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lazy-loading 'flavor' on Instance uuid b80abc7a-c016-418d-9e37-bfb4d0ae5d8d {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:38:12.926823 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4a426d8b-11ee-455b-afd2-329ac1556441 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/action" status: 202 len: 0 microversion: 2.20 time: 0.231684 Oct 17 10:38:12.927485 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 581/1140] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 10:38:12 2022] POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:38:12.936456 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:12.937095 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:12.943847 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:12.944495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:12.944944 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:12.945989 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:12.947224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:12.947589 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:13.084530 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:13.093672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:13.095133 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:13.096285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-59fb8ee3-ab8c-4713-97f6-7cd71836355b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.164605 Oct 17 10:38:13.096844 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 560/1141] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:12 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:14.123430 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:14.124124 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:14.131149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:14.131618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:14.132039 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:14.132742 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:14.133189 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:14.133602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:14.261914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:14.270123 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:14.271603 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:14.272761 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0c03be64-f06d-490a-ab97-4270183ccb88 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.155056 Oct 17 10:38:14.273314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 582/1142] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:14 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:15.298371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:15.298999 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:15.305370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:15.305849 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:15.306280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:15.307037 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:15.307489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:15.307908 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:15.436296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:15.444320 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:15.445749 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:15.447012 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a1eeff7f-a7d1-4940-b9ba-395cfd8785bb tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.152547 Oct 17 10:38:15.447566 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 561/1143] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:15 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:16.473050 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:16.473621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:16.479880 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:16.480353 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:16.480788 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:16.482377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:16.482830 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:16.483250 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:16.612673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:16.620694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:16.622676 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:16.623843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-186bf14c-8f45-414a-b45d-81f6976fa43f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.154811 Oct 17 10:38:16.624402 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 583/1144] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:16 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:17.649080 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:17.649689 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:17.657086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:17.657563 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:17.657991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:17.658709 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:17.659165 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:17.659584 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:17.789590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:17.797683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:17.799153 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:17.800310 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ef7be2d4-22de-4649-8d6c-e49abc1d96c0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.155160 Oct 17 10:38:17.800870 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 562/1145] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:17 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:18.825439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:18.826053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:18.832392 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:18.832869 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:18.833299 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:18.833980 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:18.834455 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:18.834873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:18.962051 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:18.970870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:18.972313 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:18.973509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a482c604-8750-4b13-ad5e-402a054d12be tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.152052 Oct 17 10:38:18.974357 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 584/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:18 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:20.000934 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:20.001591 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:20.007639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:20.008119 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:20.008586 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:20.009271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:20.009718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:20.010138 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:20.140289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:20.148344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:20.149801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:20.151001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-412deb45-bf07-416d-8d1d-fb84ad7eeda4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.155228 Oct 17 10:38:20.151572 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 563/1147] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:19 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:21.176775 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:21.177386 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:21.183778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:21.184817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:21.185525 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:21.185931 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:21.186417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:21.186843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:21.318466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:21.327643 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:21.329072 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:21.330227 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9537bdcb-39cf-451a-9de5-5b66580685a4 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.157336 Oct 17 10:38:21.330821 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 585/1148] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:21 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:22.355345 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:22.355981 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:22.362837 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:22.363312 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:22.363743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:22.364425 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:22.364873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:22.365289 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:22.496131 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:22.504585 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:22.506028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:22.507219 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4b75e7e8-b606-49df-9513-34217a054997 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.155787 Oct 17 10:38:22.507779 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 564/1149] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:22 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:23.532878 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:23.533493 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:23.540160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:23.540581 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:23.541014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:23.541700 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:23.542152 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:23.542601 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:23.669394 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:23.677379 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:23.678841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:23.679996 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-68f991c3-1a01-40dd-a836-ff92f2bb2cb9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.151099 Oct 17 10:38:23.680558 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 586/1150] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:23 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:24.705633 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:24.706267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:24.712717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:24.713196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:24.713628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:24.714314 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:24.714790 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:24.715218 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:24.841879 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:24.849888 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:24.851364 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:24.852522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f082decd-76bf-4b8c-8731-aa6b9a1f5c9c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1743 microversion: 2.20 time: 0.150923 Oct 17 10:38:24.853088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 565/1151] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:24 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:25.879275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:25.879911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:25.886274 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:25.886779 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:25.887933 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:25.888764 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:25.889214 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:25.889634 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:26.014544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:26.022530 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:26.023961 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:26.025138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-b7f707ae-7f2a-4ee4-83c6-d3e11b760cb2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1743 microversion: 2.20 time: 0.150053 Oct 17 10:38:26.025692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 587/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:25 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:27.050185 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:27.051048 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:27.057601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:27.058082 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:27.058567 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:27.059505 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:27.059957 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:27.060432 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:27.190560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:27.198651 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:27.200889 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:27.202054 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-f6b3490b-aff7-4d89-9b71-4c4a217a6162 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1743 microversion: 2.20 time: 0.155827 Oct 17 10:38:27.202646 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 566/1153] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:27 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:28.226814 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:28.227419 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:28.234646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:28.235119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:28.235544 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:28.236226 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:28.236683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:28.237100 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:28.368967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:28.377560 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:28.379024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:28.380178 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-39e09b0e-1e05-458c-979d-80bdd595cc93 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1743 microversion: 2.20 time: 0.157319 Oct 17 10:38:28.380738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 588/1154] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:28 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:28.420901 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "name": "network-vif-plugged", "status": "completed", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:38:28.431748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:28.432204 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:28.432628 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:28.444965 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] Creating event network-vif-plugged:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:38:28.451280 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-5b9064d3-3ee9-44b7-b350-d032bbfc9b80 req-3d828aa8-8f92-4fc8-85d6-2b7d492810da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Oct 17 10:38:28.451873 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 567/1155] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:38:29.405945 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:29.406529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:29.412459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:29.412940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:29.413376 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:29.414063 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:29.414551 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:29.414975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:29.540959 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:29.549778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:29.551241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:29.552431 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-fe4ee516-77bb-4c1f-87d0-efe5b769bd42 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1743 microversion: 2.20 time: 0.151328 Oct 17 10:38:29.552987 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 589/1156] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:29 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:30.578860 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:30.579562 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:30.586344 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:30.586855 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:30.587423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:30.588125 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:30.588764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:30.589196 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:30.736762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:30.745267 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:30.747422 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:30.748823 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-44de8c48-4697-48da-b23d-fd013939b144 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.175470 Oct 17 10:38:30.749904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 568/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:30 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:31.775065 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:31.775811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:31.782683 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:31.783415 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:31.783854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:31.784572 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:31.785032 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:31.785459 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:31.926780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:31.935755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:31.937200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:31.938599 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3398371e-f0ff-4e94-b169-1a7e0f8bca0d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.167721 Oct 17 10:38:31.939160 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 590/1158] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:31 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:32.975029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:32.975824 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:32.985479 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:32.985978 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:32.986452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:32.987183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:32.987649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:32.988069 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:33.138093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:33.146402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:33.148547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:33.150208 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-7e509150-681b-423b-b73e-d470fffea2c9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.179554 Oct 17 10:38:33.150806 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 569/1159] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:32 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:34.177575 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:34.178447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:34.185985 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:34.186580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:34.187278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:34.188231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:34.189053 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:34.189578 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:34.375740 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:34.384561 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:34.386280 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:34.388229 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e82a2ef9-7821-4a12-b3f9-7c4ee8dd69e9 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.214682 Oct 17 10:38:34.388797 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 591/1160] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:34 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:35.416380 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:35.416910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:35.424200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:35.424679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:35.425115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:35.425803 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:35.426251 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:35.426699 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:35.569360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:35.580038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:35.581487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:35.582691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c15a7444-accb-4dfc-8fff-001084de649b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.170545 Oct 17 10:38:35.583718 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 570/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:35 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:36.608416 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:36.609008 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:36.615621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:36.616114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:36.616553 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:36.617265 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:36.617724 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:36.618456 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:36.762615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:36.771287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:36.772741 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:36.773916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-93e58f95-922d-4629-869a-40a482d89212 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.169749 Oct 17 10:38:36.774727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 592/1162] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:36 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:38:37.802286 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:37.803109 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:37.814066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:37.814671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:37.815184 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:37.817122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:37.817654 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:37.819212 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:37.973079 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:37.983962 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:37.985336 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:37.986552 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0a280f0e-dcaf-4f65-a593-65f36f6cc4ee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.188366 Oct 17 10:38:37.987330 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 571/1163] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:37 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:39.016314 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:39.017580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:39.024273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:39.024776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:39.025224 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:39.025913 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:39.026387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:39.026808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:39.175932 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:39.187014 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:39.190346 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:39.191659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8abdd775-abea-4d67-b9ef-eda5ae04b7e2 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.183190 Oct 17 10:38:39.192223 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 593/1164] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:39 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:40.217540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:40.218093 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:40.224560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:40.225048 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:40.225489 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:40.226195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:40.226682 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:40.227114 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:40.359671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:40.367760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:40.369202 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:40.370371 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5ee07e9e-45ce-4f6a-a1ab-221524579bba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1738 microversion: 2.20 time: 0.156986 Oct 17 10:38:40.370926 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 572/1165] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:40 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:41.395991 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:41.396529 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:41.403671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:41.404151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:41.404594 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:41.405287 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:41.405771 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:41.406193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:41.533540 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:41.541464 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:41.543019 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:41.544936 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-70d95382-b2dc-46de-a44b-f8f030a9d07f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1720 microversion: 2.20 time: 0.152930 Oct 17 10:38:41.545510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 594/1166] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:41 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:42.570716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:42.571433 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:42.573967 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=29 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:42.580099 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:42.580679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:42.581142 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:42.581932 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:42.582428 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:42.582857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:42.587481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=79 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:42.720653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:42.728746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:42.730200 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:42.732384 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aff6b7f9-d808-4623-8a1d-87606f55b4bf tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1723 microversion: 2.20 time: 0.165455 Oct 17 10:38:42.732938 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 573/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:42 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:38:42.758533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a9001cc-6489-4243-82f0-06026ef3a873"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:38:42.760780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:42.763356 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=29 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:42.768609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:42.769084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:42.769513 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:42.770198 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:42.770673 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:42.771092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:42.773570 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:38:43.229786 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-0ec39383-ba82-4c21-9d19-9475b6756d13 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.475652 Oct 17 10:38:43.230547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 595/1168] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 17 10:38:42 2022] POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments => generated 188 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 10:38:43.354058 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:43.354587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:43.360952 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.361434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.361871 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.362600 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.363057 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.363486 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.591754 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-0b57c50e-9919-4de5-95c1-216ba8c0805c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments/6a9001cc-6489-4243-82f0-06026ef3a873" status: 202 len: 0 microversion: 2.20 time: 0.241474 Oct 17 10:38:43.592386 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 574/1169] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 17 10:38:43 2022] DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments/6a9001cc-6489-4243-82f0-06026ef3a873 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:38:43.652914 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:38:43.653509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:43.660134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.660618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.661054 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.661747 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.662200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.662659 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.691013 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118679) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 10:38:43.755101 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2643d75f-72a5-400f-ab8c-3b49106da5e0 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/action" status: 202 len: 0 microversion: 2.20 time: 0.106241 Oct 17 10:38:43.755689 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 596/1170] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 17 10:38:43 2022] POST /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:38:43.764560 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:43.765172 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:43.771126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.771601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.772031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.772728 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:43.773176 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:43.773592 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:43.905742 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:43.914451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:43.915942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:43.917115 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-29804aed-204b-4a9e-b971-f36002350aab tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1671 microversion: 2.20 time: 0.157058 Oct 17 10:38:43.917685 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 575/1171] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:43 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:44.452031 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "name": "network-vif-unplugged", "status": "completed", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:38:44.462918 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:44.463395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:44.464021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:44.482092 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] Creating event network-vif-unplugged:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:38:44.487271 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-35c80ef3-57f8-41fe-8737-7903fdfc654c req-aea65d87-8aab-4a5c-8fdb-6e205aa8c4c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040590 Oct 17 10:38:44.487868 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 597/1172] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:38:44.943053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:44.943751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:44.950440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:44.950941 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:44.951381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:44.952085 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:44.952543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:44.952970 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:45.422503 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:45.430801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:45.432263 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:45.433419 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-989a61e7-1e2c-4c2d-ace9-0f50173a3601 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.494417 Oct 17 10:38:45.435126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 576/1173] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:44 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:46.463105 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:46.463835 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:46.472808 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:46.473205 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:46.473635 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:46.474345 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:46.474795 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:46.475210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:46.617760 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:46.630016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:46.631484 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:46.632686 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-8ed7b234-5511-41be-9c05-525409d2372d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.175271 Oct 17 10:38:46.633239 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 598/1174] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:46 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:47.659809 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:47.660420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:47.667103 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:47.667588 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:47.668100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:47.668799 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:47.669342 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:47.669765 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:47.810255 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:47.818580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:47.820013 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:47.821170 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c1392640-953a-40a1-b71e-852381e5e050 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.165261 Oct 17 10:38:47.834360 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 577/1175] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:47 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:48.848803 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:48.850200 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:48.857870 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:48.858381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:48.858841 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:48.859565 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:48.860017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:48.860447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:49.001117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:49.009828 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:49.011295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:49.013867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-57f4fc2e-3ab8-4b55-9c49-acb5d4402266 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.170167 Oct 17 10:38:49.014609 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 599/1176] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:48 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:50.039615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:50.040219 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:50.046487 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:50.046971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:50.047409 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:50.048110 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:50.048577 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:50.049020 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:50.205216 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:50.213815 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:50.215287 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:50.217117 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-aa8398e9-ccf0-4d55-a1df-b4966e0ad83b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.181630 Oct 17 10:38:50.218271 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 578/1177] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:50 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:51.244963 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:51.245592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:51.252901 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:51.253444 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:51.253940 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:51.254739 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:51.255272 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:51.255765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:51.396638 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:51.404867 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:51.406318 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:51.407510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-6979e478-8cf8-4f47-9d50-1c098793126d tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.166604 Oct 17 10:38:51.408266 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 600/1178] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:51 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:52.433506 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:52.434088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:52.440717 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:52.441203 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:52.441648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:52.442369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:52.442832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:52.443258 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:52.586046 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:52.596648 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:52.599561 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:52.601150 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-76f39b6d-7935-47f9-b99a-936064280e4b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.171698 Oct 17 10:38:52.611729 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 579/1179] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:52 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:53.626758 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:53.627489 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:53.634463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:53.634937 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:53.635367 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:53.636080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:53.636543 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:53.636967 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:53.781809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:53.790437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:53.791892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:53.793073 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e0739f9d-b410-45bd-a05e-f52f3327a761 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.170368 Oct 17 10:38:53.793637 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 601/1180] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:53 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 10:38:54.818991 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:54.819579 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:54.826949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:54.827431 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:54.827859 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:54.828550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:54.829001 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:54.829420 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:54.959688 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:54.967744 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:54.969193 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:54.970435 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4ea12a9e-1f06-4fd8-b00d-32899b0957c1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.155343 Oct 17 10:38:54.971008 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 580/1181] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:54 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:55.995423 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:55.996029 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:56.002948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:56.003426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:56.003854 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:56.004534 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:56.004982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:56.005400 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:56.135122 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:56.143806 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:56.145254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:56.146441 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a5ede8c8-8868-4726-98ba-89b0fa9c94ba tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.154913 Oct 17 10:38:56.147011 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 602/1182] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:55 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:57.173659 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:57.174545 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:57.180856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:57.181334 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:57.181762 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:57.182477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:57.182923 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:57.183340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:57.312499 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:57.320567 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:57.322000 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:57.323179 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-67642df4-599a-4a14-919f-f90d55967e08 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.155247 Oct 17 10:38:57.323733 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 581/1183] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:57 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:58.349468 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:58.350017 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:58.357222 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:58.357707 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:58.358140 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:58.358860 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:58.359311 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:58.359734 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:58.492002 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:58.500639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:58.502075 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:58.503255 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-18cded1d-5c85-4115-94c6-8e9e14909f36 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.157831 Oct 17 10:38:58.503815 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 603/1184] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:58 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:38:59.528440 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:38:59.529055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:38:59.535621 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:59.536104 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:59.536542 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:59.537243 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:38:59.537696 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:38:59.538123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:38:59.750084 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:59.758270 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:59.759797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:38:59.760954 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9237db7c-714b-4d88-a605-513f05934022 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.236606 Oct 17 10:38:59.761515 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 582/1185] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:38:59 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:00.786527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:00.787139 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:00.793273 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:00.793750 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:00.794181 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:00.794894 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:00.795943 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:00.796479 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:00.928752 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:00.936839 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:00.938275 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:00.939566 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c9b9089d-e63e-412b-93c3-fda3d07008c8 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.156906 Oct 17 10:39:00.940143 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 604/1186] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:00 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:01.964649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:01.965266 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:01.971746 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:01.972233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:01.972668 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:01.973400 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:01.973862 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:01.974313 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:02.102168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:02.111125 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:02.112557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:02.113725 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-13f2789d-9eb5-4880-bf5b-6a2b8ecfe99b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.153033 Oct 17 10:39:02.114259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 583/1187] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:01 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:02.577554 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "name": "network-vif-plugged", "status": "completed", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:39:02.589485 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:02.589966 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:02.590426 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:02.601813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] Creating event network-vif-plugged:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:39:02.607268 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-58e9bd46-a01f-4e6f-95ab-b1cf66831252 req-a14de73c-2d28-46dd-b048-1e4e80d66a9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Oct 17 10:39:02.607934 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 605/1188] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:39:03.139816 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:03.140381 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:03.146895 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:03.147375 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:03.147807 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:03.148490 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:03.148940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:03.149357 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:03.284597 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:03.292587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:03.294050 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:03.295231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-cc76855b-9b80-463b-aa39-f19a52d55690 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.159892 Oct 17 10:39:03.296507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 584/1189] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:03 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:04.322651 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:04.323583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:04.330024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:04.330604 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:04.330988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:04.331690 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:04.332151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:04.332580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:04.461220 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:04.469917 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:04.471412 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:04.472698 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-272b4a99-1304-43d8-b387-503cbe074dee tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1729 microversion: 2.20 time: 0.155289 Oct 17 10:39:04.473564 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 606/1190] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:04 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:05.500065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:05.500667 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:05.507210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:05.507683 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:05.508113 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:05.508793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:05.509240 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:05.509658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:05.637214 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:05.646190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:05.647698 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:05.648840 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e3a7381f-8bb0-4ab2-923a-1d615cfdc42f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1716 microversion: 2.20 time: 0.153679 Oct 17 10:39:05.649396 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 585/1191] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:05 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:53.647320 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:53.649460 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:53.651873 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:39:53.652537 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:39:53.660671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.661154 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.661591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:53.662284 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.662765 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.663185 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:53.693305 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d147c8e1-b969-40a0-9e4b-15068fbfe0ec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050020 Oct 17 10:39:53.693858 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 607/1192] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 17 10:39:53 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:39:53.757107 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:53.757634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:53.759872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=25 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:39:53.760529 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:39:53.766832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.767327 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.767766 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:53.768465 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.768919 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.769347 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:53.795968 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:39:53.871743 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-86b491f1-c715-4491-9d0f-3af3286948ff tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 204 len: 0 microversion: 2.20 time: 0.117935 Oct 17 10:39:53.872504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 586/1193] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 10:39:53 2022] DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 10:39:53.881083 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:53.881693 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:53.887632 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.888114 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.888550 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:53.889238 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:53.889692 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:53.890121 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:54.118789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:54.126988 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:54.128404 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:54.129591 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-790a37a4-43ee-4a82-9cc7-f812d58f8327 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.252499 Oct 17 10:39:54.130150 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 608/1194] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:53 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:55.155930 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:55.156630 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:55.163352 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:55.163836 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:55.164274 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:55.164995 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:55.165451 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:55.165874 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:55.357868 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:55.366044 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:55.367522 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:55.368680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-94ad2791-b185-464c-a886-aac4d0951fe1 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1722 microversion: 2.20 time: 0.217062 Oct 17 10:39:55.369247 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 587/1195] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:55 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:56.395041 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:56.396174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:56.402155 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:56.402662 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:56.403091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:56.403787 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:56.404234 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:56.404652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:56.470016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:56.478728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:56.480319 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5efdc755c6a43f9b8cf570ac38b25eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41305c4efa44edb98d1ca076ccbdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:39:56.481488 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9c64f855-9e3e-4e55-b043-1572b533afec tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 200 len: 1654 microversion: 2.20 time: 0.091146 Oct 17 10:39:56.482195 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 609/1196] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:56 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 1654 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 10:39:56.719701 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80abc7a-c016-418d-9e37-bfb4d0ae5d8d", "name": "network-vif-deleted", "tag": "0872e6ba-5811-4142-ba61-5f28758869af"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:39:56.731571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:56.732059 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:56.732736 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:56.747161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] Creating event network-vif-deleted:0872e6ba-5811-4142-ba61-5f28758869af for instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d on hv-cinder-86020 Oct 17 10:39:56.753254 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-d313fe8f-07e3-4c13-869f-715cd5156329 req-61b1e55e-499c-4bcd-b0eb-c01c1bb7ba00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037357 Oct 17 10:39:56.753880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 588/1197] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:39:57.508714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:57.509352 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:39:57.516447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:57.518348 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:57.519015 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:57.519768 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:39:57.520219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:39:57.520642 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:39:57.535207 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d HTTP/1.1 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:39:57.536925 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:39:57.538618 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'b80abc7a-c016-418d-9e37-bfb4d0ae5d8d'} Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:39:57.539518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:39:57.540950 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:39:57.542778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:39:57.542778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cd4a4be4-40d1-4b72-872c-89be1bce63fe tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 404 len: 111 microversion: 2.20 time: 0.033597 Oct 17 10:39:57.542778 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 610/1198] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:39:57 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:39:57.547810 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c1f38b24-c25a-455f-a650-9f3936d4ea18 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '.version_select at 0x7fe9ba7f89d0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:39:57.552581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1f38b24-c25a-455f-a650-9f3936d4ea18 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [43913d0d-1d3b-4c1f-81a9-79f145e008ed] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 10:39:58.559910 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1f38b24-c25a-455f-a650-9f3936d4ea18 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [43913d0d-1d3b-4c1f-81a9-79f145e008ed] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 32964. Oct 17 10:39:58.577581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c1f38b24-c25a-455f-a650-9f3936d4ea18 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867892735" status: 204 len: 0 microversion: 2.20 time: 1.033968 Oct 17 10:39:58.578161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 589/1199] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 17 10:39:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867892735 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 10:40:00.569583 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:00.570080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:40:00.575951 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:00.576429 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:00.576864 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:00.577552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:00.578034 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:00.578494 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:00.592190 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d HTTP/1.1 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:40:00.593743 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.596086 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': 'b80abc7a-c016-418d-9e37-bfb4d0ae5d8d'} Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:00.597146 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.598857 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.600463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:00.600463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-4a20b2bf-dc40-4761-b987-2d73339aeb7c tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 404 len: 111 microversion: 2.20 time: 0.029620 Oct 17 10:40:00.600463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 611/1200] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 10:40:00 2022] DELETE /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:40:00.603946 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:00.604679 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: b80abc7a-c016-418d-9e37-bfb4d0ae5d8d] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:40:00.611526 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:00.612002 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:00.612434 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:00.613122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:00.613579 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:00.614034 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:00.627587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d HTTP/1.1 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:40:00.629195 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.630939 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'b80abc7a-c016-418d-9e37-bfb4d0ae5d8d'} Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:00.632025 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. Oct 17 10:40:00.634156 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:00.635565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance b80abc7a-c016-418d-9e37-bfb4d0ae5d8d could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:00.635565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-a3544dea-f98b-45ec-b782-156ff308785f tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d" status: 404 len: 111 microversion: 2.20 time: 0.030954 Oct 17 10:40:00.635565 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 590/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:40:00 2022] GET /compute/v2.1/servers/b80abc7a-c016-418d-9e37-bfb4d0ae5d8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:40:01.767782 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:01.768338 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:40:01.774694 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:01.775180 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:01.775611 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:01.776307 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:01.776763 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:01.777186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:01.791403 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 HTTP/1.1 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:40:01.792946 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.794766 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '239b5400-d752-426a-a5f1-fe0746c3e990'} Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:01.795672 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.797293 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.798998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:01.798998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-cc00249a-a7b9-4fc8-bee1-d709dfd7fe6b tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 404 len: 111 microversion: 2.20 time: 0.031157 Oct 17 10:40:01.798998 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 612/1202] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 17 10:40:01 2022] DELETE /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:40:01.802767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:01.803382 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] [instance: 239b5400-d752-426a-a5f1-fe0746c3e990] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:40:01.809665 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:01.810147 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:01.810622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:01.811312 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:40:01.811771 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:40:01.812199 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:40:01.825105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] HTTP exception thrown: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Request method failure captured: Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 HTTP/1.1 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTS8wOc5xYwKe_n_1WxZcO8wYXBRxmuizVEntaR-v2jvOAjHJV0faUoOK0XuB4KyEzHobxsS1G5MukxKl1fFDzSeJsU5C0yM70N3gViR8w5qyWgr90a7Cx1bo1uB77aQKmva67vSqWIq34MpN9OtJYKLBDuq8cgNdrMR-juUtXU5GuWY Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:40:01.826650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a41305c4efa44edb98d1ca076ccbdff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 6a41305c4efa44edb98d1ca076ccbdff Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-35631923 Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: e5efdc755c6a43f9b8cf570ac38b25eb Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-35631923-project Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.828372 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '239b5400-d752-426a-a5f1-fe0746c3e990'} Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:01.830590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. Oct 17 10:40:01.832225 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:01.833650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] Returning 404 to user: Instance 239b5400-d752-426a-a5f1-fe0746c3e990 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:01.833650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6196913a-8a01-4791-aa2b-f3847a9320a3 tempest-AttachVolumeShelveTestJSON-35631923 tempest-AttachVolumeShelveTestJSON-35631923-project] 10.222.0.16 "GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990" status: 404 len: 111 microversion: 2.20 time: 0.029053 Oct 17 10:40:01.833650 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 591/1203] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 17 10:40:01 2022] GET /compute/v2.1/servers/239b5400-d752-426a-a5f1-fe0746c3e990 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 10:40:06.239598 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-631b8853-c12d-45c3-ac73-1bd146b2c3da tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Action: 'create', calling method: .version_select at 0x7fe9ba88b5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1620234329"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:40:06.531210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-631b8853-c12d-45c3-ac73-1bd146b2c3da tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.405006 Oct 17 10:40:06.540463 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 613/1204] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Oct 17 10:40:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 10:40:06.545942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-69cc086e-d7c6-4350-8c76-41b05562fcdb tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba5d7f70>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:06.600557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-69cc086e-d7c6-4350-8c76-41b05562fcdb tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 200 len: 345 microversion: 2.1 time: 0.058408 Oct 17 10:40:06.601122 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 592/1205] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:40:06 2022] GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:07.616834 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-3e9aa295-e14f-4413-9e12-adc78809c1fa tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9bdf82700>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:07.667757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-3e9aa295-e14f-4413-9e12-adc78809c1fa tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 200 len: 346 microversion: 2.1 time: 0.054437 Oct 17 10:40:07.667757 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 614/1206] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:40:07 2022] GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:07.683361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-07b4b637-46ec-4c12-b42c-c874d037c782 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Action: 'create', calling method: .version_select at 0x7fe9ba910dc0>, body: {"snapshot": {"volume_id": "3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1216820443"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:40:07.854469 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-07b4b637-46ec-4c12-b42c-c874d037c782 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.176013 Oct 17 10:40:07.855060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 593/1207] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Oct 17 10:40:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:07.866723 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d6ece688-29ae-4115-af2c-8ac035180a76 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba6de430>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:07.896824 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d6ece688-29ae-4115-af2c-8ac035180a76 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.033878 Oct 17 10:40:07.897396 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 615/1208] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:07 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:07.909126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-144ba8b6-1653-4c7f-825f-cd62bc08cc04 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba8d51f0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:07.939337 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-144ba8b6-1653-4c7f-825f-cd62bc08cc04 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034981 Oct 17 10:40:07.939904 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 594/1209] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 17 10:40:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:40:07.950900 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-1749e141-14b6-4a28-91e5-36c6536ffc2d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9bdf78700>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:07.981021 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-1749e141-14b6-4a28-91e5-36c6536ffc2d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.033813 Oct 17 10:40:07.981587 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 616/1210] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:07 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:08.995666 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-69299907-c4b1-40d3-b50a-86e851b66ea3 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba7dcd30>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:09.025869 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-69299907-c4b1-40d3-b50a-86e851b66ea3 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.034911 Oct 17 10:40:09.026471 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 595/1211] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:08 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:10.040310 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-5482ba62-ae28-403d-bbc8-eaa227069435 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba4f5a60>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:10.070597 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-5482ba62-ae28-403d-bbc8-eaa227069435 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.034961 Oct 17 10:40:10.071199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 617/1212] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:10 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:11.083864 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3e6676f9-c28b-45ad-8bf1-908282052cfd tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba7f8ee0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:11.115383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3e6676f9-c28b-45ad-8bf1-908282052cfd tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.035862 Oct 17 10:40:11.115949 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 596/1213] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:11 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:12.125451 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=12 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:40:12.126417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=24 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:40:12.130691 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-85e99c6f-d7b4-43b6-acd5-b4158ed2517a tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9bdf788b0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:12.161134 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-85e99c6f-d7b4-43b6-acd5-b4158ed2517a tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 288 microversion: 2.1 time: 0.036782 Oct 17 10:40:12.161699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 618/1214] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:12 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:12.170068 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:40:12.170909 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:40:12.175653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-ec266b8d-d82f-45e2-82d7-ba902776c71d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba7dc700>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:12.235126 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-ec266b8d-d82f-45e2-82d7-ba902776c71d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 202 len: 0 microversion: 2.1 time: 0.065754 Oct 17 10:40:12.236192 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 597/1215] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 17 10:40:12 2022] DELETE /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:40:12.244301 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c72b3769-dbd5-4380-ab41-5c6728580810 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba6de280>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:12.273355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c72b3769-dbd5-4380-ab41-5c6728580810 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 200 len: 287 microversion: 2.1 time: 0.032876 Oct 17 10:40:12.273912 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 619/1216] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:12 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:40:13.287003 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22105efa-3ae1-4546-bbff-7430003c299d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9bb487280>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:13.313404 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-22105efa-3ae1-4546-bbff-7430003c299d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] HTTP exception thrown: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22105efa-3ae1-4546-bbff-7430003c299d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Request method failure captured: Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd HTTP/1.1 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTTEG7zQYfmXbH-as8oPE7Pbnsk1s2-xyLfo4PN_dYweXw-jOSlu71HrU8vwCuT6ucW2ev3EVtc-ilr_xw3X4kNIPPFWG-jdTLVuhp7NSaHfwm32GPEWlw4KQ4CuddO9xE0XVVxm0V0Rd37-M2zhvtpoXHGS3ZgZbjKq_wPt2ENQ_Oig Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:40:13.316281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b580463e35646b583faee9675f11e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b580463e35646b583faee9675f11e60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 273b683e939347eabf1e4730481791f0 Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '05e7e633-a165-4d7a-a81f-8e3ac5cf64cd'} Oct 17 10:40:13.318053 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. (HTTP 404) (Request-ID: req-5fc37d1a-4543-482b-8685-511651f1c975) Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.319137 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:13.320452 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 10:40:13.321764 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-22105efa-3ae1-4546-bbff-7430003c299d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Returning 404 to user: Snapshot 05e7e633-a165-4d7a-a81f-8e3ac5cf64cd could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:13.323168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-22105efa-3ae1-4546-bbff-7430003c299d tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd" status: 404 len: 111 microversion: 2.1 time: 0.036591 Oct 17 10:40:13.324265 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 598/1217] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 17 10:40:13 2022] GET /compute/v2.1/os-snapshots/05e7e633-a165-4d7a-a81f-8e3ac5cf64cd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:40:13.327129 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-533dcfa0-c058-4d4b-b9d4-e44853a48c05 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba841b80>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:13.389337 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-533dcfa0-c058-4d4b-b9d4-e44853a48c05 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 202 len: 0 microversion: 2.1 time: 0.066609 Oct 17 10:40:13.389904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 620/1218] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:40:13 2022] DELETE /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:40:13.398734 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-3ce026a7-b497-49f3-8d5a-b73d81ff7804 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9babd6040>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:13.448088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-3ce026a7-b497-49f3-8d5a-b73d81ff7804 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 200 len: 345 microversion: 2.1 time: 0.053215 Oct 17 10:40:13.448711 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 599/1219] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:40:13 2022] GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 10:40:14.464084 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-83935d73-e630-414e-8980-72db0f9348de tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba4f53a0>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:14.491930 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-83935d73-e630-414e-8980-72db0f9348de tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] HTTP exception thrown: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-83935d73-e630-414e-8980-72db0f9348de tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Request method failure captured: Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f HTTP/1.1 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTTEG7zQYfmXbH-as8oPE7Pbnsk1s2-xyLfo4PN_dYweXw-jOSlu71HrU8vwCuT6ucW2ev3EVtc-ilr_xw3X4kNIPPFWG-jdTLVuhp7NSaHfwm32GPEWlw4KQ4CuddO9xE0XVVxm0V0Rd37-M2zhvtpoXHGS3ZgZbjKq_wPt2ENQ_Oig Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:40:14.493890 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b580463e35646b583faee9675f11e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b580463e35646b583faee9675f11e60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 273b683e939347eabf1e4730481791f0 Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f'} Oct 17 10:40:14.495624 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. (HTTP 404) (Request-ID: req-8fed8560-1508-4c89-ac38-c9f022aead0e) Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.496658 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:14.498202 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 10:40:14.499810 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-83935d73-e630-414e-8980-72db0f9348de tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Returning 404 to user: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-83935d73-e630-414e-8980-72db0f9348de tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 404 len: 109 microversion: 2.1 time: 0.035663 Oct 17 10:40:14.502675 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 621/1220] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:40:14 2022] GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:40:14.510224 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25bc0dd9-5fc9-4022-adf7-27390052354c tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9ba8d51f0>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:14.537640 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-25bc0dd9-5fc9-4022-adf7-27390052354c tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] HTTP exception thrown: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25bc0dd9-5fc9-4022-adf7-27390052354c tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Request method failure captured: Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: DELETE /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f HTTP/1.1 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTTEG7zQYfmXbH-as8oPE7Pbnsk1s2-xyLfo4PN_dYweXw-jOSlu71HrU8vwCuT6ucW2ev3EVtc-ilr_xw3X4kNIPPFWG-jdTLVuhp7NSaHfwm32GPEWlw4KQ4CuddO9xE0XVVxm0V0Rd37-M2zhvtpoXHGS3ZgZbjKq_wPt2ENQ_Oig Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:40:14.539652 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b580463e35646b583faee9675f11e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b580463e35646b583faee9675f11e60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 273b683e939347eabf1e4730481791f0 Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': '3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f'} Oct 17 10:40:14.541392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. (HTTP 404) (Request-ID: req-5b505edd-823c-441d-af13-82eff78d673f) Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.542475 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 10:40:14.543976 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 10:40:14.545580 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-25bc0dd9-5fc9-4022-adf7-27390052354c tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Returning 404 to user: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:14.547135 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-25bc0dd9-5fc9-4022-adf7-27390052354c tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 404 len: 109 microversion: 2.1 time: 0.035187 Oct 17 10:40:14.549309 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 600/1221] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 17 10:40:14 2022] DELETE /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:40:14.550381 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7299da3d-6979-4294-a911-3ae141f63519 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Calling method '.version_select at 0x7fe9bdf78820>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:40:14.578168 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-7299da3d-6979-4294-a911-3ae141f63519 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] HTTP exception thrown: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7299da3d-6979-4294-a911-3ae141f63519 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Request method failure captured: Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f HTTP/1.1 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTTEG7zQYfmXbH-as8oPE7Pbnsk1s2-xyLfo4PN_dYweXw-jOSlu71HrU8vwCuT6ucW2ev3EVtc-ilr_xw3X4kNIPPFWG-jdTLVuhp7NSaHfwm32GPEWlw4KQ4CuddO9xE0XVVxm0V0Rd37-M2zhvtpoXHGS3ZgZbjKq_wPt2ENQ_Oig Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:40:14.580194 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b580463e35646b583faee9675f11e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b580463e35646b583faee9675f11e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b580463e35646b583faee9675f11e60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: 1b580463e35646b583faee9675f11e60 Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519860764 Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 273b683e939347eabf1e4730481791f0 Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519860764-project Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f'} Oct 17 10:40:14.581666 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. (HTTP 404) (Request-ID: req-a9dbab2e-6659-4a05-9ade-8fe5c97abec0) Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.582819 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 10:40:14.584355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 10:40:14.585977 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-7299da3d-6979-4294-a911-3ae141f63519 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] Returning 404 to user: Volume 3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-7299da3d-6979-4294-a911-3ae141f63519 tempest-VolumesSnapshotsTestJSON-1519860764 tempest-VolumesSnapshotsTestJSON-1519860764-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f" status: 404 len: 109 microversion: 2.1 time: 0.035797 Oct 17 10:40:14.588109 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 622/1222] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 17 10:40:14 2022] GET /compute/v2.1/os-volumes/3f75ab29-4f5b-4e1f-87ac-7fece86b5f2f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:41:14.503905 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-810268832", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "networks": [{"uuid": "6c1fde2e-1e15-4311-882d-644dba352e63"}]}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:41:14.557513 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] validate_networks() for [('6c1fde2e-1e15-4311-882d-644dba352e63', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:41:14.943611 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:41:14.944039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:41:14.944511 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:41:14.944921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:41:14.945332 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:41:14.954030 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:14.954557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:14.954990 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:14.955713 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:14.956168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:14.956593 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:14.973464 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Getting quotas for project f4a5813ff7244904ad8d2ac132c63cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:41:14.977532 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Getting quotas for user 409d3f7190e6423193765243268c7ceb and project f4a5813ff7244904ad8d2ac132c63cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:41:14.988660 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:41:14.990979 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:41:15.033793 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [373e4f77-bfb6-4cc1-90ee-3f1ff7790f23] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 10:41:16.042841 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [373e4f77-bfb6-4cc1-90ee-3f1ff7790f23] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33648. Oct 17 10:41:16.046730 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d6eb5ea2-e1b1-45e1-a0c3-4816554e636d tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547504 Oct 17 10:41:16.047550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 601/1223] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:41:16.059884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f0ee9a4a-2822-4363-8e48-c80d7ec76d73 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:16.060497 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f0ee9a4a-2822-4363-8e48-c80d7ec76d73 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:16.117696 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f0ee9a4a-2822-4363-8e48-c80d7ec76d73 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:16.125438 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f0ee9a4a-2822-4363-8e48-c80d7ec76d73 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1218 microversion: 2.1 time: 0.071021 Oct 17 10:41:16.125993 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 623/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:16 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:17.148795 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:17.149411 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:17.155537 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:17.156019 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:17.156460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:17.157158 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:17.157622 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:17.158048 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:17.220281 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:17.228500 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-e5f296d2-d752-4c23-83f1-199e424acc22 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1270 microversion: 2.1 time: 0.084352 Oct 17 10:41:17.229073 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 602/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:17 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:18.252395 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:18.253204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:18.260188 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:18.260674 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:18.261110 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:18.261801 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:18.262502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:18.262929 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:18.394283 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:18.403149 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-49774eb4-6db7-43b7-a635-0b523933f4d4 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.154540 Oct 17 10:41:18.403573 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 624/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:18 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:18.765160 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f7c8fe-68d6-4805-af24-3c2edce4851e", "tag": "1b03c1bb-32c4-4a7a-9756-1489af828024"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:41:18.775575 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:18.776055 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:18.776482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:18.787324 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] Creating event network-changed:1b03c1bb-32c4-4a7a-9756-1489af828024 for instance 63f7c8fe-68d6-4805-af24-3c2edce4851e on hv-cinder-86020 Oct 17 10:41:18.793233 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-b8a744fe-d562-45e4-8d05-f3a0a149e4f2 req-ec14191b-7143-4713-aae1-70e3afc593ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162117 Oct 17 10:41:18.793890 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 603/1227] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:41:19.426254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:19.426921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:19.433789 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:19.434267 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:19.434728 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:19.435413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:19.435861 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:19.436277 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:19.565508 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:19.573231 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-754b0ba1-9b41-494a-ac03-a92f68a47678 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.150835 Oct 17 10:41:19.573793 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 625/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:19 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:20.596872 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:20.597590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:20.604587 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:20.605066 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:20.605507 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:20.606190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:20.606680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:20.607100 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:20.737852 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:20.746149 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2a9228c9-a5f9-4847-b182-c0f07ed44286 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.153513 Oct 17 10:41:20.746761 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 604/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:20 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:21.768862 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:21.769502 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:21.775911 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:21.776397 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:21.776836 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:21.777528 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:21.777989 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:21.778439 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:21.903387 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:21.910948 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-a640c6a5-e035-4a90-b442-35270baec4f0 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.146000 Oct 17 10:41:21.911509 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 626/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:21 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:22.934102 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:22.934747 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:22.941152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:22.941634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:22.942071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:22.942792 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:22.943250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:22.943675 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:23.080227 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:23.088830 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-36fe7b28-c148-4bb7-956c-101d48a662d7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.158597 Oct 17 10:41:23.089423 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 605/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:22 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:24.111648 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:24.112253 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:24.119610 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:24.120091 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:24.120521 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:24.121210 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:24.121660 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:24.122080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:24.252615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:24.260939 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f3752482-f068-4217-882b-3ebc3325d388 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.153329 Oct 17 10:41:24.261511 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 627/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:24 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:25.207071 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f7c8fe-68d6-4805-af24-3c2edce4851e", "name": "network-vif-plugged", "status": "completed", "tag": "1b03c1bb-32c4-4a7a-9756-1489af828024"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:41:25.213543 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:41:25.214207 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:41:25.219896 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:25.220370 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:25.220829 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:25.232653 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] Creating event network-vif-plugged:1b03c1bb-32c4-4a7a-9756-1489af828024 for instance 63f7c8fe-68d6-4805-af24-3c2edce4851e on hv-cinder-86020 Oct 17 10:41:25.237857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-aa3c6a27-61d1-4e34-8905-0bd5e365fa5c req-623be784-f420-4326-8782-a6ae0a671a92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Oct 17 10:41:25.238649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 606/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:41:25.284922 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:25.285592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:25.292547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:25.293024 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:25.293461 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:25.294182 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:25.294708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:25.295070 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:25.429965 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:25.437881 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-c2601d5b-b27d-4095-8f71-a170e10cc610 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.156799 Oct 17 10:41:25.438505 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 628/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:25 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:26.462842 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:26.463454 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:26.469550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:26.470027 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:26.470483 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:26.471168 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:26.471618 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:26.472031 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:26.868512 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:26.876269 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-4e4674d4-8571-4b6d-ba08-663b95fc4584 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1318 microversion: 2.1 time: 0.418881 Oct 17 10:41:26.876831 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 607/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:26 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:27.900539 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:41:27.901141 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:27.903061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:41:27.908701 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:27.909179 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:27.909615 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:27.910303 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:27.910780 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:27.911204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:28.039552 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:41:28.047093 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f54d49fb-df27-4cfa-81be-a5fbfec93e49 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1507 microversion: 2.1 time: 0.151115 Oct 17 10:41:28.047652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 629/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:41:27 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:41:47.470642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dba93c7f-5e23-4b97-b0aa-08499d75b391", "device": "/dev/sdb"}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:41:47.473460 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:41:47.476028 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:41:47.476671 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=30 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:41:47.483680 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:47.484164 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:47.484601 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:47.485301 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:41:47.485754 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:41:47.486180 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:41:47.739139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-9b008800-9f1b-4bed-8ab6-6bbe4ce642a7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "POST /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272249 Oct 17 10:41:47.739786 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 608/1237] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:41:47 2022] POST /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:42:14.533678 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:14.534235 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:14.536470 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 10:42:14.536617 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Mon Oct 17 10:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments/dba93c7f-5e23-4b97-b0aa-08499d75b391 (ip 10.222.0.16) !!! Oct 17 10:42:14.537585 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=16 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:14.538278 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=36 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:14.540036 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 10:42:14.540162 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Mon Oct 17 10:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments/dba93c7f-5e23-4b97-b0aa-08499d75b391 (ip 10.222.0.16) !!! Oct 17 10:42:14.542128 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 10:42:14.542254 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Mon Oct 17 10:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments/dba93c7f-5e23-4b97-b0aa-08499d75b391 (ip 10.222.0.16) !!! Oct 17 10:42:14.553485 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:14.553982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:14.554469 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:14.555186 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:14.555652 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:14.556076 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:14.641730 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.objects.instance [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lazy-loading 'services' on Instance uuid 63f7c8fe-68d6-4805-af24-3c2edce4851e {{(pid=118679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:42:14.713999 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e9944f00-62e1-4044-b025-9d02ee228d65 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments/dba93c7f-5e23-4b97-b0aa-08499d75b391" status: 202 len: 0 microversion: 2.1 time: 0.183447 Oct 17 10:42:14.714732 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 630/1238] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:42:14 2022] DELETE /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e/os-volume_attachments/dba93c7f-5e23-4b97-b0aa-08499d75b391 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:42:15.834626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:15.835383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:15.840339 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:15.840921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:15.848450 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:15.848931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:15.849369 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:15.850060 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:15.850547 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:15.850971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:15.876940 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Going to try to terminate instance {{(pid=118680) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:42:15.950921 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-1e35446c-bcea-4200-9cdb-1caded0e686f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 204 len: 0 microversion: 2.1 time: 0.117690 Oct 17 10:42:15.951550 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 609/1239] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:42:15 2022] DELETE /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:42:15.960843 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:15.961535 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:15.968432 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:15.968904 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:15.969333 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:15.970016 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:15.970500 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:15.970921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:16.102033 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:16.110136 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-34fd1576-8d63-4445-934d-1e3d99023ca8 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1513 microversion: 2.1 time: 0.153931 Oct 17 10:42:16.110738 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 631/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:15 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:17.133141 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:17.133881 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:17.140556 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:17.141043 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:17.141492 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:17.142190 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:17.142677 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:17.143105 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:17.272535 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:17.280993 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6e899808-0e2a-433a-b60b-493e602b1434 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1513 microversion: 2.1 time: 0.152179 Oct 17 10:42:17.281564 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 610/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:17 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:18.281212 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f7c8fe-68d6-4805-af24-3c2edce4851e", "name": "network-vif-deleted", "tag": "1b03c1bb-32c4-4a7a-9756-1489af828024"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:42:18.293809 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:18.294892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:18.295322 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:18.305088 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:18.305884 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:18.308596 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] Creating event network-vif-deleted:1b03c1bb-32c4-4a7a-9756-1489af828024 for instance 63f7c8fe-68d6-4805-af24-3c2edce4851e on hv-cinder-86020 Oct 17 10:42:18.313649 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:18.314563 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-76351a5c-6f04-44a4-a3b3-f5ac24a175b2 req-cc4dbd72-745a-43f3-a888-2f76ce96028d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Oct 17 10:42:18.315173 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 632/1242] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:42:18.315548 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:18.316029 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:18.316750 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:18.317277 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:18.317626 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:18.383557 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:18.392038 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6bc6ead7-37b9-4562-a913-80d2be13cbc6 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 200 len: 1303 microversion: 2.1 time: 0.091303 Oct 17 10:42:18.392721 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 611/1243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:18 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 10:42:19.415428 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:19.416279 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: 63f7c8fe-68d6-4805-af24-3c2edce4851e] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:19.422942 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:19.423417 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:19.423846 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:19.424527 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:19.424976 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:19.425393 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:19.438817 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.wsgi [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] HTTP exception thrown: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Request method failure captured: Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: request: GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e HTTP/1.1 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept: application/json Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Accept-Encoding: identity Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Connection: close Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Length: 0 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Content-Type: application/json Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Host: 10.222.0.16 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: Openstack-System-Scope: None Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: User-Agent: python-urllib3/1.26.12 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Auth-Token: gAAAAABjTTFISylXo-U7O1BTZmyhFMuU6ZJeP_4xPbhu4-NtXMLNRlLtOlggWEthWqjVF91THN1hsHFJIUFsQqLQte9NpzPSHfEmmIpi4a1EizW_7sANlZMQ7MII52lktNG-lSpFVmxN_Uzurz2K3LhEEG0lRd2s65dccXKYnTvLpDyztAJ8Mqg Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Id: None Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Domain-Name: None Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Identity-Status: Confirmed Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Is-Admin-Project: True Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Id: default Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Domain-Name: Default Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Id: f4a5813ff7244904ad8d2ac132c63cf9 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Project-Name: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Role: reader,member Oct 17 10:42:19.440408 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Roles: reader,member Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Id: f4a5813ff7244904ad8d2ac132c63cf9 Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User: tempest-VolumesSnapshotTestJSON-143309301-project Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Id: default Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Domain-Name: Default Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Id: 409d3f7190e6423193765243268c7ceb Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: X-User-Name: tempest-VolumesSnapshotTestJSON-143309301-project Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: method: > Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: exception: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. Oct 17 10:42:19.442193 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: action_args: {'id': '63f7c8fe-68d6-4805-af24-3c2edce4851e'} Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:42:19.443507 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. Oct 17 10:42:19.445219 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: ERROR nova.api.openstack.wsgi Oct 17 10:42:19.446921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Returning 404 to user: Instance 63f7c8fe-68d6-4805-af24-3c2edce4851e could not be found. {{(pid=118679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:42:19.446921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-9c8ff1b5-cea5-4282-aa3e-3db263d49b68 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e" status: 404 len: 111 microversion: 2.1 time: 0.030648 Oct 17 10:42:19.446921 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 633/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:19 2022] GET /compute/v2.1/servers/63f7c8fe-68d6-4805-af24-3c2edce4851e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 10:42:29.286097 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1072511333", "imageRef": "f32da11b-92e2-481c-968c-6808b53fe89c", "flavorRef": "452", "networks": [{"uuid": "6c1fde2e-1e15-4311-882d-644dba352e63"}]}} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:42:29.295812 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:29.296470 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:29.344393 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.network.neutron [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] validate_networks() for [('6c1fde2e-1e15-4311-882d-644dba352e63', None, None, None, None, None)] {{(pid=118680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 10:42:29.687065 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Flavor limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 10:42:29.687495 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Image limits 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 10:42:29.687972 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Flavor pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 10:42:29.688383 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Image pref 0:0:0 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 10:42:29.688797 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.virt.hardware [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 10:42:29.697639 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:29.698124 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:29.698595 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:29.699328 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:29.700340 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:29.700767 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:29.717234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Getting quotas for project f4a5813ff7244904ad8d2ac132c63cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 10:42:29.721283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.quota [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Getting quotas for user 409d3f7190e6423193765243268c7ceb and project f4a5813ff7244904ad8d2ac132c63cf9. Resources: {'instances', 'cores', 'ram'} {{(pid=118680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 10:42:29.732408 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Going to run 1 instances... {{(pid=118680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 10:42:29.734971 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f32da11b-92e2-481c-968c-6808b53fe89c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 10:42:29.781045 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-2aa0be94-c11d-4d1b-a63b-0d9b5d5b571e tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498776 Oct 17 10:42:29.781757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 612/1245] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 17 10:42:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 10:42:29.792848 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-d1448461-42b4-4062-9f43-a107024693df tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:29.793542 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-d1448461-42b4-4062-9f43-a107024693df tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:29.796080 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=8 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:29.796727 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:29.850174 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-d1448461-42b4-4062-9f43-a107024693df tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:29.857151 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-d1448461-42b4-4062-9f43-a107024693df tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1219 microversion: 2.1 time: 0.068292 Oct 17 10:42:29.857709 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 634/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:29 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:30.880828 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:30.881455 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:30.888231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:30.888726 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:30.889152 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:30.889857 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:30.890353 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:30.890772 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:30.961985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:30.971341 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-298e0015-432a-4c01-8499-ef527ace5175 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1289 microversion: 2.1 time: 0.094496 Oct 17 10:42:30.971848 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 613/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:30 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:31.994437 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:31.995183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:32.002606 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:32.003079 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:32.003510 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:32.004199 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:32.004646 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:32.005058 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:32.136049 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:32.144714 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-ac8d5f1b-8624-4cb8-8f3d-825ec2f38855 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.153922 Oct 17 10:42:32.158350 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 635/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:31 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:32.165392 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1eb613f-b52f-4a7b-9c21-1588a8d22bd5", "tag": "bc1ffe0a-cb09-4a53-9f9f-51168aa2994f"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:42:32.175691 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:32.176177 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:32.176615 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:32.187798 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] Creating event network-changed:bc1ffe0a-cb09-4a53-9f9f-51168aa2994f for instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 on hv-cinder-86020 Oct 17 10:42:32.193546 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-5d5a1bd5-923b-4347-b279-d6a07a02794e req-3d95d6ff-67d4-4a47-94fe-8dfc9aaf3869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048465 Oct 17 10:42:32.194148 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 614/1249] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:42:33.173466 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:33.174225 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:33.180680 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:33.181164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:33.181602 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:33.182349 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:33.182807 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:33.183233 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:33.313571 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:33.321245 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-e9c7be1f-7686-4e5d-b948-e4c7490e65f7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.151942 Oct 17 10:42:33.321813 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 636/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:33 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:34.345276 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:34.345899 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:34.352075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:34.352559 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:34.352985 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:34.353672 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:34.354129 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:34.354604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:34.484145 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:34.491833 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-c42a98fb-14f8-46eb-9b92-6a2998931fd7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.151468 Oct 17 10:42:34.492402 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 615/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:34 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:35.515377 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:35.515982 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:35.522196 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:35.522699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:35.523126 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:35.523811 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:35.524257 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:35.524671 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:35.656020 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:35.664845 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-46cff6a1-4c1f-4771-97fa-c6653df627e7 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.153795 Oct 17 10:42:35.665518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 637/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:35 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:36.688390 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:36.689014 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:36.695441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:36.695924 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:36.696361 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:36.697123 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:36.697504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:36.697931 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:36.824775 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:36.833024 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b4208252-ea23-4345-981f-8bb5481a89a2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.149192 Oct 17 10:42:36.833590 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 616/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:36 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:37.642746 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eb613f-b52f-4a7b-9c21-1588a8d22bd5", "name": "network-vif-plugged", "status": "completed", "tag": "bc1ffe0a-cb09-4a53-9f9f-51168aa2994f"}]} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:42:37.652164 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:37.653251 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:37.653699 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:37.664413 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.compute.server_external_events [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] Creating event network-vif-plugged:bc1ffe0a-cb09-4a53-9f9f-51168aa2994f for instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 on hv-cinder-86020 Oct 17 10:42:37.669406 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [req-a4dc11e8-a1ce-4e02-a51a-3b0c56eb6288 req-164d05e6-e659-4283-bab2-f09a51c916f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091888 Oct 17 10:42:37.670044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 638/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:42:37.855962 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:37.856571 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:37.863446 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:37.863933 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:37.864368 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:37.865074 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:37.865520 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:37.865942 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:38.016482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:38.024140 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-d800a975-c9a9-4db7-b036-d4d06d7f3eee tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.172060 Oct 17 10:42:38.024715 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 617/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:37 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:39.047424 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:39.048118 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:39.054708 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:39.055183 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:39.055613 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:39.056295 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:39.056749 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:39.057166 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:39.193241 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:39.202639 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-169db9e3-ffe9-47b1-8ad8-40dbdf199f70 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1319 microversion: 2.1 time: 0.159495 Oct 17 10:42:39.203215 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 639/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:39 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:40.225880 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:42:40.226443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:40.228882 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=2 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:40.229581 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell0:SELECT=6 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:40.236387 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:40.236865 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:40.237295 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:40.237984 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:40.238468 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:40.238894 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:40.374146 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:42:40.381915 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-b240accf-6702-40ed-a90e-97a163e4a904 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1508 microversion: 2.1 time: 0.159964 Oct 17 10:42:40.382540 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 618/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:42:40 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:42:40.404975 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a118260-8004-4d1c-863a-15f95f92eba2", "device": "/dev/sdb"}} {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:42:40.407892 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:42:40.409884 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell0:SELECT=2 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:42:40.415992 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:40.416477 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:40.416916 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:40.417612 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:42:40.418064 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:42:40.418533 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:42:40.669508 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-f69dcbca-26f7-472c-b715-a3502a91c4e1 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "POST /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268933 Oct 17 10:42:40.670119 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 640/1258] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 17 10:42:40 2022] POST /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:43:02.099250 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:02.099801 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:02.101716 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:43:02.102482 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG dbcounter [-] [118680] Writing DB stats nova_cell1:SELECT=34 {{(pid=118680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:43:02.108832 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:02.109602 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:02.110039 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:02.110760 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:02.111215 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:02.111642 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:02.191610 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.objects.instance [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lazy-loading 'services' on Instance uuid a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 {{(pid=118680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 10:43:02.262234 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-5ed37f40-34fe-4105-9b72-80e52db898ab tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5/os-volume_attachments/7a118260-8004-4d1c-863a-15f95f92eba2" status: 202 len: 0 microversion: 2.1 time: 0.166932 Oct 17 10:43:02.262856 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 619/1259] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 17 10:43:02 2022] DELETE /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5/os-volume_attachments/7a118260-8004-4d1c-863a-15f95f92eba2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 10:43:03.383661 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_api:SELECT=16 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:43:03.384491 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG dbcounter [-] [118679] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 10:43:03.388580 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:03.389153 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:03.397291 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:03.397776 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:03.398192 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:03.398905 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:03.399355 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:03.399773 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:03.426398 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Going to try to terminate instance {{(pid=118679) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 10:43:03.501755 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-834c8b1a-5a60-498e-8bc8-93a253b3ecb2 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 204 len: 0 microversion: 2.1 time: 0.119324 Oct 17 10:43:03.503066 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 641/1260] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 17 10:43:03 2022] DELETE /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 10:43:03.512362 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:03.513210 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:03.522604 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:03.523283 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:03.523720 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:03.524424 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:03.524885 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:03.525296 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:03.653634 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.policy [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:43:03.662161 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-55096c23-4119-4ed1-a6de-26cd7c50537f tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1514 microversion: 2.1 time: 0.154919 Oct 17 10:43:03.662751 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 620/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:43:03 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:43:04.685447 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:04.686061 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:04.693117 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:04.693592 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:04.694018 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:04.694760 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:04.695204 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:04.695621 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:04.825547 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:43:04.833656 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-2734a754-edf0-46d8-95e3-a3b30f164651 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1514 microversion: 2.1 time: 0.152515 Oct 17 10:43:04.834236 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 642/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:43:04 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:43:05.807220 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1eb613f-b52f-4a7b-9c21-1588a8d22bd5", "name": "network-vif-deleted", "tag": "bc1ffe0a-cb09-4a53-9f9f-51168aa2994f"}]} {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 10:43:05.819259 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:05.819748 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:05.820183 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:05.832481 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.compute.server_external_events [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] Creating event network-vif-deleted:bc1ffe0a-cb09-4a53-9f9f-51168aa2994f for instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 on hv-cinder-86020 Oct 17 10:43:05.837477 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [req-1da8b6f2-df20-4bfd-980c-ca3df69c7bc9 req-ce7aa0f6-7b5c-43a9-a8f8-c69a3a6e6c9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Oct 17 10:43:05.838075 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 621/1263] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 17 10:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 10:43:05.856903 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.api.openstack.wsgi [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:05.857518 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.compute.api [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118679) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:05.864209 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:05.864695 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:05.865138 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:05.865837 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:05.866296 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:05.866748 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG oslo_concurrency.lockutils [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:05.934192 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: DEBUG nova.policy [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409d3f7190e6423193765243268c7ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a5813ff7244904ad8d2ac132c63cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 10:43:05.943044 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: INFO nova.api.openstack.requestlog [None req-bf2be079-2d3a-48ac-bb8e-d68891032528 tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 200 len: 1304 microversion: 2.1 time: 0.089945 Oct 17 10:43:05.943626 dv-cinder-860209-5-iscsi devstack@n-api.service[118679]: [pid: 118679|app: 0|req: 643/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:43:05 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 10:43:06.966504 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Calling method '>' {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 10:43:06.967211 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.compute.api [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] [instance: a1eb613f-b52f-4a7b-9c21-1588a8d22bd5] Fetching instance by UUID {{(pid=118680) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 10:43:06.974139 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:06.974644 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:06.975086 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:06.975774 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Acquiring lock "66ef73f3-9115-4ace-9509-220fc52b388b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 10:43:06.976231 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 10:43:06.976658 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG oslo_concurrency.lockutils [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Lock "66ef73f3-9115-4ace-9509-220fc52b388b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 10:43:06.989811 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.wsgi [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] HTTP exception thrown: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Request method failure captured: Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: request: GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 HTTP/1.1 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept: application/json Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Accept-Encoding: identity Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Connection: close Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Length: 0 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Content-Type: application/json Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Host: 10.222.0.16 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: Openstack-System-Scope: None Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: User-Agent: python-urllib3/1.26.12 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Auth-Token: gAAAAABjTTFISylXo-U7O1BTZmyhFMuU6ZJeP_4xPbhu4-NtXMLNRlLtOlggWEthWqjVF91THN1hsHFJIUFsQqLQte9NpzPSHfEmmIpi4a1EizW_7sANlZMQ7MII52lktNG-lSpFVmxN_Uzurz2K3LhEEG0lRd2s65dccXKYnTvLpDyztAJ8Mqg Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Id: None Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Domain-Name: None Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Identity-Status: Confirmed Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Is-Admin-Project: True Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Id: default Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Domain-Name: Default Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Id: f4a5813ff7244904ad8d2ac132c63cf9 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Role: reader,member Oct 17 10:43:06.991443 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Roles: reader,member Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f4a5813ff7244904ad8d2ac132c63cf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Id: f4a5813ff7244904ad8d2ac132c63cf9 Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-143309301 Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User: tempest-VolumesSnapshotTestJSON-143309301-project Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Id: default Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Domain-Name: Default Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Id: 409d3f7190e6423193765243268c7ceb Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: X-User-Name: tempest-VolumesSnapshotTestJSON-143309301-project Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: method: > Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: exception: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. Oct 17 10:43:06.993319 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: action_args: {'id': 'a1eb613f-b52f-4a7b-9c21-1588a8d22bd5'} Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: {{(pid=118680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 10:43:06.994441 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. Oct 17 10:43:06.996285 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: ERROR nova.api.openstack.wsgi Oct 17 10:43:06.997757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: DEBUG nova.api.openstack.wsgi [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] Returning 404 to user: Instance a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 could not be found. {{(pid=118680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 10:43:06.997757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: INFO nova.api.openstack.requestlog [None req-6d02bbfb-1ba0-4e13-8f07-81f1015deeec tempest-VolumesSnapshotTestJSON-143309301 tempest-VolumesSnapshotTestJSON-143309301-project] 10.222.0.16 "GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5" status: 404 len: 111 microversion: 2.1 time: 0.031124 Oct 17 10:43:06.997757 dv-cinder-860209-5-iscsi devstack@n-api.service[118680]: [pid: 118680|app: 0|req: 622/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 17 10:43:06 2022] GET /compute/v2.1/servers/a1eb613f-b52f-4a7b-9c21-1588a8d22bd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)